Jul 16 12:45:16.148767 ip-10-0-131-226 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 12:45:16.536358 ip-10-0-131-226 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 12:45:16.536358 ip-10-0-131-226 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 12:45:16.536358 ip-10-0-131-226 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 12:45:16.536358 ip-10-0-131-226 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 12:45:16.536358 ip-10-0-131-226 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 12:45:16.538844 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.538754    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 12:45:16.543223 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543207    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:45:16.543223 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543223    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543229    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543232    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543238    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543243    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543246    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543250    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543253    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543256    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543260    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543263    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543266    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543269    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543272    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543274    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543277    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543280    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543283    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543286    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543289    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:45:16.543289 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543292    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543295    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543298    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543301    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543309    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543312    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543315    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543318    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543320    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543323    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543325    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543328    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543331    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543334    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543337    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543339    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543342    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543344    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543347    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543349    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:45:16.543787 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543352    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543355    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543359    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543361    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543364    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543366    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543369    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543372    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543374    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543377    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543380    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543383    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543385    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543389    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543392    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543394    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543397    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543399    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543402    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:45:16.544321 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543405    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543409    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543414    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543417    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543420    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543423    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543426    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543429    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543433    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543436    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543439    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543442    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543444    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543447    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543450    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543454    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543457    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543459    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543462    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:45:16.544822 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543465    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543468    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543471    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543474    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543477    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543479    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543482    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543485    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543488    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543491    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543493    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543496    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543500    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543504    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543507    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543510    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543514    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543517    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543519    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:45:16.545322 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.543522    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544283    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544291    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544295    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544300    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544312    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544316    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544319    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544323    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544325    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544329    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544332    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544336    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544339    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544342    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544363    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544367    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544370    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544372    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:45:16.545836 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544375    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544379    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544384    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544388    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544391    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544394    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544397    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544400    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544403    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544406    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544409    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544412    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544415    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544417    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544420    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544423    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544425    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544428    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544432    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:45:16.546310 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544435    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544438    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544441    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544443    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544446    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544451    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544454    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544457    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544460    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544463    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544465    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544468    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544472    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544474    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544478    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544481    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544483    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544486    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544489    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:45:16.546816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544492    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544494    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544497    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544499    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544502    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544505    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544508    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544511    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544514    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544518    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544521    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544524    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544527    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544531    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544534    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544536    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544539    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544542    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544546    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544549    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:45:16.547309 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544552    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544556    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544559    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544562    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544564    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544567    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544570    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544573    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544575    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544578    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544581    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544584    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544586    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544589    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544592    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544594    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544597    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544600    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544602    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544605    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:45:16.547816 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544608    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544610    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.544613    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545025    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545031    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545034    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545037    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545040    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545043    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545046    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545050    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545053    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545056    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545059    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545062    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545065    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545068    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545071    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545073    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545076    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:45:16.548319 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545079    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545083    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545087    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545090    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545094    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545097    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545100    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545103    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545106    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545109    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545112    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545115    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545118    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545121    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545124    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545126    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545129    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545132    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545134    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:45:16.548863 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545137    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545140    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545143    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545146    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545149    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545152    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545155    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545158    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545161    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545163    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545166    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545169    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545171    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545174    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545177    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545196    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545200    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545204    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545207    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:45:16.549356 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545209    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545212    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545215    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545219    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545222    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545227    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545230    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545233    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545236    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545239    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545242    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545245    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545247    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545250    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545253    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545256    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545259    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545262    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545265    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545268    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:45:16.549838 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545272    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545274    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545277    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545280    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545283    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545286    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545289    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545291    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545294    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545298    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545301    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545303    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545306    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545309    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545311    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545315    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545317    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545322    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545325    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:45:16.550353 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545328    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545331    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545335    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545338    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.545341    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545422    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545432    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545443    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545450    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545459    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545466    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545471    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545476    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545480    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545484    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545487    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545491    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545494    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545497    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545500    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545504    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545507    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545510    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 12:45:16.550826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545514    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545517    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545520    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545524    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545527    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545531    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545534    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545539    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545543    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545546    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545549    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545552    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545556    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545559    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545563    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545567    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545570    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545573    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545577    2564 flags.go:64] FLAG: --enable-server="true"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545580    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545586    2564 flags.go:64] FLAG: --event-burst="100"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545590    2564 flags.go:64] FLAG: --event-qps="50"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545593    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545596    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 12:45:16.551393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545600    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545603    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545607    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545610    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545613    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545616    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545633    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545636    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545639    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545642    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545645    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545648    2564 flags.go:64] FLAG: --feature-gates=""
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545652    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545655    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545659    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545663    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545666    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545670    2564 flags.go:64] FLAG: --help="false"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545673    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-226.ec2.internal"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545676    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545679    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545682    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545686    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 12:45:16.552000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545689    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545692    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545695    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545700    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545703    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545706    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545709    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545712    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545715    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545719    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545722    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545725    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545728    2564 flags.go:64] FLAG: --lock-file=""
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545731    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545734    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545737    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545743    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545746    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545748    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545751    2564 flags.go:64] FLAG: --logging-format="text"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545754    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545758    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545761    2564 flags.go:64] FLAG: --manifest-url=""
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545764    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545770    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 12:45:16.552672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545773    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545778    2564 flags.go:64] FLAG: --max-pods="110"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545781    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545784    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545787    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545790    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545793    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545796    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545799    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545807    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545812    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545815    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545819    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545822    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545827    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545830    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545833    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545837    2564 flags.go:64] FLAG: --port="10250"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545841    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545844    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b97940ad75fbb497"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545847    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545851    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545854    2564 flags.go:64] FLAG: --register-node="true"
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545857    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 16 12:45:16.553370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545861    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545864    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545867    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545870    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545874    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545877    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545880    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545885    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545888    2564 flags.go:64] FLAG: --runonce="false"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545891    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545894    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545897    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545900    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545904    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545907    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545910    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545913    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545916    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545919    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545923    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545926    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545930    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545933    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545936    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545941    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 12:45:16.553985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545944    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545947    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545951    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545955    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545957    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545960    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545963    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545966    2564 flags.go:64] FLAG: --v="2"
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545970    2564 flags.go:64] FLAG: --version="false"
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545974    2564 flags.go:64] FLAG: --vmodule=""
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545978    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.545982    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546102    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546106    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546110    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546113    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546115    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546118    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546121    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546125    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546128    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546130    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:45:16.554647 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546133    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546136    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546139    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546141    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546145    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546150    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546154    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546157    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546160    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546163    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546166    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546169    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546173    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546176    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546178    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546194    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546197    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546201    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546204    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546206    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:45:16.555378 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546209    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546212    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546214    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546217    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546221    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546224    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546227    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546232    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546236    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546238    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546241    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546244    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546247    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546250    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546252    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546255    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546260    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546263    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546265    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:45:16.555886 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546270    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546274    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546277    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546280    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546283    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546286    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546297    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546300    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546302    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546305    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546308    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546311    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546314    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546317    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546320    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546323    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546326    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546330    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546333    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:45:16.556420 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546336    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546339    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546342    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546344    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546347    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546350    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546352    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546355    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546358    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546361    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546365    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546368    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546371    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546373    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546376    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546379    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546382    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546385    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546387    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546390    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:45:16.556888 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546394    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546396    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546399    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546402    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546404    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546407    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546410    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546412    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546415    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546418    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.546423    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.546428    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.554052    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.554069    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.555018    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 12:45:16.557442 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.555031    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555102    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555108    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555112    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555116    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555119    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555121    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555125    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555128    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555131    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555134    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555137    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555140    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555142    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555145    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555148    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555150    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555153    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555156    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555159    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:45:16.557837 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555161    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555164    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555167    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555169    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555172    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555175    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555177    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555180    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555198    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555203    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555215    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555219    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555222    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555227    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555231    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555234    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555237    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555240    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555243    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555245    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:45:16.558370 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555248    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555250    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555255    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555259    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555262    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555265    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555268    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555271    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555273    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555276    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555279    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555282    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555284    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555287    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555289    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555292    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555295    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555297    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555300    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:45:16.558968 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555303    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555306    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555308    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555312    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555321    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555324    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555327    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555330    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555332    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555335    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555337    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555340    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555343    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555346    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555348    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555351    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555354    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555356    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555359    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555361    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:45:16.559507 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555364    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555367    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555370    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555372    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555375    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555377    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555380    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555383    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555386    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555389    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555392    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555394    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555397    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555400    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555402    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555405    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555408    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555417    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555420    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555423    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:45:16.560024 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555426    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.555431    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555586    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555592    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555595    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555598    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555601    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555604    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555606    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555609    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555612    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555615    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555618    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555622    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555626    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:45:16.560556 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555629    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555632    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555635    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555638    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555640    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555643    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555646    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555648    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555651    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555654    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555656    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555659    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555661    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555664    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555667    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555676    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555679    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555682    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555685    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555687    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:45:16.560950 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555690    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555693    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555696    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555698    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555701    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555704    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555706    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555709    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555711    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555714    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555717    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555719    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555722    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555725    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555727    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555730    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555733    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555736    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555739    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555741    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:45:16.561463 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555744    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555746    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555749    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555752    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555755    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555758    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555760    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555763    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555772    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555775    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555778    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555780    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555783    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555785    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555788    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555791    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555793    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555796    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555799    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:45:16.561998 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555803    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555806    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555809    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555812    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555815    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555818    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555820    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555823    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555826    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555829    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555832    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555834    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555837    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555839    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555842    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555845    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555848    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555850    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555853    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:45:16.562605 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555856    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555859    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555861    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555872    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555875    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555885    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555888    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:16.555891    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.555896    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.556033    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.558451    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.559877    2564 server.go:1019] "Starting client certificate rotation"
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.559981    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 12:45:16.563491 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.560767    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 12:45:16.564941 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.564922    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 12:45:16.566577 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.566557    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 12:45:16.575644 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.575626    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 16 12:45:16.577711 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.577696    2564 log.go:25] "Validated CRI v1 image API"
Jul 16 12:45:16.579386 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.579364    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 12:45:16.582355 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.582335    2564 fs.go:135] Filesystem UUIDs: map[0b8197ee-9998-4f36-8c89-ca286b4ddcd4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e5ba1304-62ae-465c-94b3-4fb0cc3fc04c:/dev/nvme0n1p3]
Jul 16 12:45:16.582413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.582355    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 12:45:16.588386 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.588231    2564 manager.go:216] Machine: {Timestamp:2026-07-16 12:45:16.58703484 +0000 UTC m=+0.326024612 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199726 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23d0e2f3972fa4e24a74e8748ad33c SystemUUID:ec23d0e2-f397-2fa4-e24a-74e8748ad33c BootID:c9eed295-34be-41aa-aafb-686a6bf4d731 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:a5:40:1b:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:a5:40:1b:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:5d:39:19:ae:65 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 12:45:16.588386 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.588383    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 12:45:16.588525 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.588512    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 12:45:16.590595 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.590567    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 12:45:16.590759 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.590597    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 12:45:16.591358 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.591348    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 12:45:16.591397 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.591360    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 12:45:16.591397 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.591373    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 12:45:16.592033 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.592004    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 12:45:16.593912 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.593901    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 12:45:16.596903 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.596890    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 12:45:16.597048 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597038    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 12:45:16.597102 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597093    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 12:45:16.597155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597114    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 12:45:16.597155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597134    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 12:45:16.597155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597144    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 16 12:45:16.597312 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597174    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 12:45:16.597617 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597601    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 12:45:16.597676 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.597624    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 12:45:16.598285 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.598267    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 12:45:16.602435 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.602415    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 12:45:16.604540 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604523    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 12:45:16.604612 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604555    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 12:45:16.604751 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604741    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 12:45:16.604783 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604757    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 12:45:16.604783 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604764    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 12:45:16.604783 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604769    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 12:45:16.604783 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604778    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 12:45:16.604783 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.604784    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 12:45:16.605347 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605337    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 12:45:16.605347 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605347    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 12:45:16.605413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605355    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 12:45:16.605413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605361    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 12:45:16.605413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605370    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 12:45:16.605413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605379    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 12:45:16.605413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605401    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 12:45:16.605413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.605407    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 12:45:16.608739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.608724    2564 server.go:1268] "Started kubelet"
Jul 16 12:45:16.608849 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.608798    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 12:45:16.608910 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.608867    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 12:45:16.608963 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.608939    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 12:45:16.609288 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.609268    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-226.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 12:45:16.609397 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.609371    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 12:45:16.609527 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.609503    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 12:45:16.610103 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.610084    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 12:45:16.610285 ip-10-0-131-226 systemd[1]: Started Kubernetes Kubelet.
Jul 16 12:45:16.611168 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.610984    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 12:45:16.613775 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.613754    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 12:45:16.615561 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.615542    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 12:45:16.615561 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.615557    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 12:45:16.615695 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.615664    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:16.616534 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.616500    2564 factory.go:55] Registering systemd factory
Jul 16 12:45:16.616534 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.616519    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 16 12:45:16.616739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.616728    2564 factory.go:153] Registering CRI-O factory
Jul 16 12:45:16.616739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.616740    2564 factory.go:223] Registration of the crio container factory successfully
Jul 16 12:45:16.616826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.616780    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 12:45:16.616826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.616798    2564 factory.go:103] Registering Raw factory
Jul 16 12:45:16.616826 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.616814    2564 manager.go:1196] Started watching for new ooms in manager
Jul 16 12:45:16.617234 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.617219    2564 manager.go:349] Starting recovery of all containers
Jul 16 12:45:16.617656 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.617393    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 12:45:16.617656 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.617412    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 12:45:16.617656 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.617548    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 12:45:16.617656 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.617560    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 12:45:16.617876 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.617859    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 12:45:16.618049 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.615423    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-226.ec2.internal.18c2c5d3f99c7fed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.ec2.internal,UID:ip-10-0-131-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.ec2.internal,},FirstTimestamp:2026-07-16 12:45:16.608692205 +0000 UTC m=+0.347681976,LastTimestamp:2026-07-16 12:45:16.608692205 +0000 UTC m=+0.347681976,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.ec2.internal,}"
Jul 16 12:45:16.620705 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.620679    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 12:45:16.620891 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.620871    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 12:45:16.624723 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.624694    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmtrm"
Jul 16 12:45:16.629787 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.629768    2564 manager.go:354] Recovery completed
Jul 16 12:45:16.631693 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.631670    2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 16 12:45:16.634896 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.634881    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:45:16.637287 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.637272    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:45:16.637363 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.637306    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:45:16.637363 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.637321    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:45:16.637819 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.637805    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 12:45:16.637819 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.637816    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 12:45:16.637933 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.637824    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:45:16.637933 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.637832    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 12:45:16.638592 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.638577    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:45:16.638702 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.638608    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:45:16.638702 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.638623    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:45:16.639014 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.639001    2564 policy_none.go:49] "None policy: Start"
Jul 16 12:45:16.639433 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.639421    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 12:45:16.639468 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.639443    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 12:45:16.640365 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.640351    2564 policy_none.go:47] "Start"
Jul 16 12:45:16.640691 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.640598    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-226.ec2.internal.18c2c5d3fb50d32c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.ec2.internal,UID:ip-10-0-131-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-226.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.ec2.internal,},FirstTimestamp:2026-07-16 12:45:16.637287212 +0000 UTC m=+0.376276990,LastTimestamp:2026-07-16 12:45:16.637287212 +0000 UTC m=+0.376276990,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.ec2.internal,}"
Jul 16 12:45:16.642446 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.642427    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmtrm"
Jul 16 12:45:16.689937 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.689769    2564 manager.go:337] "Starting Device Plugin manager"
Jul 16 12:45:16.690039 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.689980    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 12:45:16.690039 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.689996    2564 server.go:87] "Starting device plugin registration server"
Jul 16 12:45:16.690287 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.690274    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 12:45:16.690321 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.690290    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 12:45:16.690421 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.690401    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 12:45:16.690511 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.690498    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 12:45:16.690571 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.690512    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 12:45:16.690997 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.690953    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 12:45:16.691087 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.691011    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:16.791399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.791310    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:45:16.793206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.792329    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:45:16.793206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.792363    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:45:16.793206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.792379    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:45:16.793206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.792412    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-226.ec2.internal"
Jul 16 12:45:16.816486 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.816460    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-226.ec2.internal"
Jul 16 12:45:16.816486 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.816487    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-226.ec2.internal\": node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:16.825953 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.825927    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 12:45:16.827398 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.827376    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 12:45:16.827504 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.827422    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 12:45:16.827504 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.827446    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 12:45:16.827504 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.827479    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 12:45:16.830480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.830461    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:45:16.841132 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.841109    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:16.928692 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.928660    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"]
Jul 16 12:45:16.928789 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.928735    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:45:16.929758 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.929739    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:45:16.929819 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.929774    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:45:16.929819 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.929786    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:45:16.931904 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.931891    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:45:16.932039 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:16.932075 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932058    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:45:16.932615 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932588    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:45:16.932615 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932616    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:45:16.932768 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932595    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:45:16.932768 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932630    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:45:16.932768 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932650    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:45:16.932768 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.932663    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:45:16.934635 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.934616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:16.934739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.934649    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:45:16.935343 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.935324    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:45:16.935416 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.935360    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:45:16.935416 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:16.935375    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:45:16.941538 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.941524    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:16.956945 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.956925    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.ec2.internal\" not found" node="ip-10-0-131-226.ec2.internal"
Jul 16 12:45:16.961390 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:16.961375    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.ec2.internal\" not found" node="ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.020412 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.020385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/62d0507dd5f34f08d10a81f149614966-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"62d0507dd5f34f08d10a81f149614966\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.020500 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.020422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ae6cf55f8063ebcd37c44cf473c45a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"5ae6cf55f8063ebcd37c44cf473c45a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.020500 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.020448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae6cf55f8063ebcd37c44cf473c45a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"5ae6cf55f8063ebcd37c44cf473c45a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.042585 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.042534    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:17.120734 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.120684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ae6cf55f8063ebcd37c44cf473c45a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"5ae6cf55f8063ebcd37c44cf473c45a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.120817 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.120739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae6cf55f8063ebcd37c44cf473c45a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"5ae6cf55f8063ebcd37c44cf473c45a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.120817 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.120758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/62d0507dd5f34f08d10a81f149614966-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"62d0507dd5f34f08d10a81f149614966\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.120817 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.120789    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/62d0507dd5f34f08d10a81f149614966-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"62d0507dd5f34f08d10a81f149614966\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.120817 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.120791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ae6cf55f8063ebcd37c44cf473c45a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"5ae6cf55f8063ebcd37c44cf473c45a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.120944 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.120799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae6cf55f8063ebcd37c44cf473c45a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"5ae6cf55f8063ebcd37c44cf473c45a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.143492 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.143465    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:17.243961 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.243933    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:17.259246 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.259216    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.264397 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.264216    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.345068 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.344981    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:17.446856 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.446808    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:17.547514 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.547486    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found"
Jul 16 12:45:17.559102 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.559081    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 12:45:17.559300 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.559279    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 12:45:17.586539 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.586517    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:45:17.597442 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.597384    2564 apiserver.go:52] "Watching apiserver"
Jul 16 12:45:17.608479 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.608458    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 12:45:17.608814 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.608794    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-7fvbf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86","openshift-cluster-node-tuning-operator/tuned-ps2vd","openshift-image-registry/node-ca-7c9x4","openshift-multus/multus-pf5kf","openshift-multus/network-metrics-daemon-pzs8z","openshift-network-diagnostics/network-check-target-4ww9t","openshift-network-operator/iptables-alerter-l7kq6","kube-system/global-pull-secret-syncer-qc2j4","openshift-dns/node-resolver-b89fz","openshift-multus/multus-additional-cni-plugins-fkn2j","openshift-ovn-kubernetes/ovnkube-node-nbls2"]
Jul 16 12:45:17.611194 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.611163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.613197 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.613176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.615903 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.614469    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 12:45:17.615903 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.614747    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w4fcj\""
Jul 16 12:45:17.615903 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.615005    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 12:45:17.615903 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.615882    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 12:45:17.615903 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.615887    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.616309 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.616141    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 12:45:17.616309 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.616210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.616641 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.616621    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 12:45:17.616800 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.616783    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t65lt\""
Jul 16 12:45:17.617460 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.617445    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 12:45:17.618894 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.618871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.619076 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.619048    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 12:45:17.619076 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.619060    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 12:45:17.619256 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.619103    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nq4gr\""
Jul 16 12:45:17.621035 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.621017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.621433 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.621412    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 12:45:17.621500 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.621482    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 12:45:17.621500 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.621492    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tztl2\""
Jul 16 12:45:17.621772 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.621752    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 12:45:17.623101 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8137dd54-1895-4825-8bd3-9f1a1c333487-serviceca\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.623197 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.623197 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-device-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.623197 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623148    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 12:45:17.623405 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysctl-d\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.623405 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-tuned\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.623405 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwxd\" (UniqueName: \"kubernetes.io/projected/8137dd54-1895-4825-8bd3-9f1a1c333487-kube-api-access-9bwxd\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.623405 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-registration-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.623405 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-modprobe-d\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.623405 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-systemd\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623458    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg5n2\" (UniqueName: \"kubernetes.io/projected/499b9624-7914-491b-8f60-5ca24c01a2bc-kube-api-access-cg5n2\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-socket-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.623513    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-sys-fs\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623552    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623503    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k2vpk\""
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wgp\" (UniqueName: \"kubernetes.io/projected/31cc2ad0-bf5b-4396-8e25-40dde49480e9-kube-api-access-h7wgp\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-sys\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ecee6e5-846a-40a8-9e97-4a3b4e81b94e-konnectivity-ca\") pod \"konnectivity-agent-7fvbf\" (UID: \"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e\") " pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.623687 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-lib-modules\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/499b9624-7914-491b-8f60-5ca24c01a2bc-tmp\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-run\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8137dd54-1895-4825-8bd3-9f1a1c333487-host\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-host\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysconfig\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-kubernetes\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysctl-conf\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ecee6e5-846a-40a8-9e97-4a3b4e81b94e-agent-certs\") pod \"konnectivity-agent-7fvbf\" (UID: \"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e\") " pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.623993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.624228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.624029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-var-lib-kubelet\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.625409 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.625392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:17.625475 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.625456    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:17.627631 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.627612    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.629992 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.629975    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.630080 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.630054    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rgqqm\""
Jul 16 12:45:17.630220 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.630079    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 12:45:17.630220 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.630083    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:17.630476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.630455    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 12:45:17.630792 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.630771    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 12:45:17.631435 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.631421    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 12:45:17.631502 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.631474    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"
Jul 16 12:45:17.632271 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.632254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.634471 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.634453    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 12:45:17.634715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.634702    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4h5t\""
Jul 16 12:45:17.634773 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.634759    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 12:45:17.634843 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.634821    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.637124 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.637107    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal"]
Jul 16 12:45:17.637228 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.637211    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.637290 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.637277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mkljl\""
Jul 16 12:45:17.637471 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.637454    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 12:45:17.637858 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.637841    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 12:45:17.637963 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.637946    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 12:45:17.639942 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.639927    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 12:45:17.640058 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.640040    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 12:45:17.640100 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.640084    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 12:45:17.640150 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.640100    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2pc9z\""
Jul 16 12:45:17.640254 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.640239    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 12:45:17.640333 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.640320    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 12:45:17.640805 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.640791    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 12:45:17.641972 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.641957    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 12:45:17.642065 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.642033    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"]
Jul 16 12:45:17.645465 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.645421    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 12:40:16 +0000 UTC" deadline="2028-03-11 19:54:17.372224831 +0000 UTC"
Jul 16 12:45:17.645541 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.645466    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14503h8m59.726763236s"
Jul 16 12:45:17.669240 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.669209    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gxr5z"
Jul 16 12:45:17.684635 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.684617    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gxr5z"
Jul 16 12:45:17.718989 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.718969    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 12:45:17.724420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-systemd\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.724492 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg5n2\" (UniqueName: \"kubernetes.io/projected/499b9624-7914-491b-8f60-5ca24c01a2bc-kube-api-access-cg5n2\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.724492 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-system-cni-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.724592 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-systemd\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.724592 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-cnibin\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.724592 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-socket-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.724592 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-kubelet\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcdf5b13-5a41-4647-8b17-ace51441af8d-iptables-alerter-script\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcdf5b13-5a41-4647-8b17-ace51441af8d-host-slash\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-node-log\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-socket-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-conf-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/645836ac-82eb-4693-bb86-4472ce1978d2-multus-daemon-config\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.724797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdcfq\" (UniqueName: \"kubernetes.io/projected/645836ac-82eb-4693-bb86-4472ce1978d2-kube-api-access-rdcfq\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8v5r\" (UniqueName: \"kubernetes.io/projected/0ce6d3aa-0d83-4ade-865f-d37af2041004-kube-api-access-x8v5r\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-log-socket\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-run\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-cni-multus\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ce6d3aa-0d83-4ade-865f-d37af2041004-hosts-file\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-systemd-units\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.724989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-systemd\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-host\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-os-release\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-etc-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-run\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-host\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725149 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysctl-conf\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/645836ac-82eb-4693-bb86-4472ce1978d2-cni-binary-copy\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-netns\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-multus-certs\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-os-release\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysctl-conf\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-slash\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-run-netns\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-var-lib-kubelet\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-k8s-cni-cncf-io\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ce6d3aa-0d83-4ade-865f-d37af2041004-tmp-dir\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-var-lib-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-var-lib-kubelet\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.725715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-device-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysctl-d\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-cni-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-device-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-system-cni-dir\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwxd\" (UniqueName: \"kubernetes.io/projected/8137dd54-1895-4825-8bd3-9f1a1c333487-kube-api-access-9bwxd\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-registration-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g8jd\" (UniqueName: \"kubernetes.io/projected/79697ba9-2a2d-4948-8c0f-f2a57ac06857-kube-api-access-2g8jd\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysctl-d\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-ovnkube-script-lib\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-sys-fs\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-registration-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wgp\" (UniqueName: \"kubernetes.io/projected/31cc2ad0-bf5b-4396-8e25-40dde49480e9-kube-api-access-h7wgp\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-sys\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-etc-kubernetes\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-sys-fs\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-dbus\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.726599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-sys\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-cni-bin\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ecee6e5-846a-40a8-9e97-4a3b4e81b94e-konnectivity-ca\") pod \"konnectivity-agent-7fvbf\" (UID: \"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e\") " pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-lib-modules\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/499b9624-7914-491b-8f60-5ca24c01a2bc-tmp\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-ovnkube-config\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-lib-modules\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.725977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8137dd54-1895-4825-8bd3-9f1a1c333487-host\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-cni-bin\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cxc\" (UniqueName: \"kubernetes.io/projected/dcdf5b13-5a41-4647-8b17-ace51441af8d-kube-api-access-w4cxc\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8137dd54-1895-4825-8bd3-9f1a1c333487-host\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-kubelet\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-ovn\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-cni-netd\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d08b78a3-00ea-45c6-b224-b216247a0002-ovn-node-metrics-cert\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysconfig\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-kubernetes\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726176    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-socket-dir-parent\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-hostroot\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-sysconfig\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-kubernetes\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-env-overrides\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmnzn\" (UniqueName: \"kubernetes.io/projected/d08b78a3-00ea-45c6-b224-b216247a0002-kube-api-access-tmnzn\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ecee6e5-846a-40a8-9e97-4a3b4e81b94e-agent-certs\") pod \"konnectivity-agent-7fvbf\" (UID: \"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e\") " pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8137dd54-1895-4825-8bd3-9f1a1c333487-serviceca\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ecee6e5-846a-40a8-9e97-4a3b4e81b94e-konnectivity-ca\") pod \"konnectivity-agent-7fvbf\" (UID: \"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e\") " pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-tuned\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-kubelet-config\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.727878 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31cc2ad0-bf5b-4396-8e25-40dde49480e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.728399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hk6s\" (UniqueName: \"kubernetes.io/projected/d58961ef-c4ac-48f5-bc94-3df3ba51073e-kube-api-access-9hk6s\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:17.728399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.728399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cnibin\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.728399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-modprobe-d\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.728399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-modprobe-d\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.728399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.726870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8137dd54-1895-4825-8bd3-9f1a1c333487-serviceca\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.729331 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.729309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/499b9624-7914-491b-8f60-5ca24c01a2bc-tmp\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.729447 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.729345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/499b9624-7914-491b-8f60-5ca24c01a2bc-etc-tuned\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.729514 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.729490    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ecee6e5-846a-40a8-9e97-4a3b4e81b94e-agent-certs\") pod \"konnectivity-agent-7fvbf\" (UID: \"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e\") " pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.735752 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.735725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwxd\" (UniqueName: \"kubernetes.io/projected/8137dd54-1895-4825-8bd3-9f1a1c333487-kube-api-access-9bwxd\") pod \"node-ca-7c9x4\" (UID: \"8137dd54-1895-4825-8bd3-9f1a1c333487\") " pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.735831 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.735735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wgp\" (UniqueName: \"kubernetes.io/projected/31cc2ad0-bf5b-4396-8e25-40dde49480e9-kube-api-access-h7wgp\") pod \"aws-ebs-csi-driver-node-thg86\" (UID: \"31cc2ad0-bf5b-4396-8e25-40dde49480e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.738170 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.738144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg5n2\" (UniqueName: \"kubernetes.io/projected/499b9624-7914-491b-8f60-5ca24c01a2bc-kube-api-access-cg5n2\") pod \"tuned-ps2vd\" (UID: \"499b9624-7914-491b-8f60-5ca24c01a2bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.827655 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-cni-multus\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ce6d3aa-0d83-4ade-865f-d37af2041004-hosts-file\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-systemd-units\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-systemd\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-os-release\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-etc-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827746    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-cni-multus\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/645836ac-82eb-4693-bb86-4472ce1978d2-cni-binary-copy\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-systemd\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ce6d3aa-0d83-4ade-865f-d37af2041004-hosts-file\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-netns\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.827850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-systemd-units\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-netns\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-os-release\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-multus-certs\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-etc-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-os-release\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-multus-certs\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-os-release\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.827975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-slash\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-run-netns\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-k8s-cni-cncf-io\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ce6d3aa-0d83-4ade-865f-d37af2041004-tmp-dir\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-var-lib-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-run-netns\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-slash\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-run-k8s-cni-cncf-io\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.828480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-cni-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-system-cni-dir\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-var-lib-openvswitch\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-system-cni-dir\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g8jd\" (UniqueName: \"kubernetes.io/projected/79697ba9-2a2d-4948-8c0f-f2a57ac06857-kube-api-access-2g8jd\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-ovnkube-script-lib\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-cni-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-etc-kubernetes\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-dbus\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/645836ac-82eb-4693-bb86-4472ce1978d2-cni-binary-copy\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-cni-bin\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-etc-kubernetes\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ce6d3aa-0d83-4ade-865f-d37af2041004-tmp-dir\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-dbus\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.829438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-ovnkube-config\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-cni-bin\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-cni-bin\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cxc\" (UniqueName: \"kubernetes.io/projected/dcdf5b13-5a41-4647-8b17-ace51441af8d-kube-api-access-w4cxc\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-kubelet\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.828622    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-ovn\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-cni-bin\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-run-ovn\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.828701    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs podName:d58961ef-c4ac-48f5-bc94-3df3ba51073e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:18.328679525 +0000 UTC m=+2.067669307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs") pod "network-metrics-daemon-pzs8z" (UID: "d58961ef-c4ac-48f5-bc94-3df3ba51073e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-kubelet\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-cni-netd\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d08b78a3-00ea-45c6-b224-b216247a0002-ovn-node-metrics-cert\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828800    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-cni-netd\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-socket-dir-parent\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-hostroot\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-env-overrides\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmnzn\" (UniqueName: \"kubernetes.io/projected/d08b78a3-00ea-45c6-b224-b216247a0002-kube-api-access-tmnzn\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-ovnkube-script-lib\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828933    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-kubelet-config\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-ovnkube-config\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828981    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-hostroot\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hk6s\" (UniqueName: \"kubernetes.io/projected/d58961ef-c4ac-48f5-bc94-3df3ba51073e-kube-api-access-9hk6s\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.828923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-socket-dir-parent\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-kubelet-config\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cnibin\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cnibin\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-system-cni-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.829199    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-cnibin\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.830739 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-kubelet\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.829250    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret podName:37e50b87-c3e2-45fb-8c7e-7fd07471b20e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:18.329233619 +0000 UTC m=+2.068223393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret") pod "global-pull-secret-syncer-qc2j4" (UID: "37e50b87-c3e2-45fb-8c7e-7fd07471b20e") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-cnibin\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-host-var-lib-kubelet\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcdf5b13-5a41-4647-8b17-ace51441af8d-iptables-alerter-script\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcdf5b13-5a41-4647-8b17-ace51441af8d-host-slash\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-system-cni-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-node-log\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcdf5b13-5a41-4647-8b17-ace51441af8d-host-slash\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-node-log\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d08b78a3-00ea-45c6-b224-b216247a0002-env-overrides\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-conf-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/645836ac-82eb-4693-bb86-4472ce1978d2-multus-conf-dir\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/645836ac-82eb-4693-bb86-4472ce1978d2-multus-daemon-config\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.831296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdcfq\" (UniqueName: \"kubernetes.io/projected/645836ac-82eb-4693-bb86-4472ce1978d2-kube-api-access-rdcfq\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8v5r\" (UniqueName: \"kubernetes.io/projected/0ce6d3aa-0d83-4ade-865f-d37af2041004-kube-api-access-x8v5r\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-log-socket\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829706    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d08b78a3-00ea-45c6-b224-b216247a0002-log-socket\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcdf5b13-5a41-4647-8b17-ace51441af8d-iptables-alerter-script\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.829910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/645836ac-82eb-4693-bb86-4472ce1978d2-multus-daemon-config\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.830071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79697ba9-2a2d-4948-8c0f-f2a57ac06857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.831872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.831567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d08b78a3-00ea-45c6-b224-b216247a0002-ovn-node-metrics-cert\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.838913 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.838895    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:45:17.839024 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.838918    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:45:17.839024 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.838933    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dpz55 for pod openshift-network-diagnostics/network-check-target-4ww9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:17.839024 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:17.838989    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55 podName:66ad8bdf-3b70-4533-93cb-84d3e9e708d3 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:18.338973166 +0000 UTC m=+2.077962948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dpz55" (UniqueName: "kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55") pod "network-check-target-4ww9t" (UID: "66ad8bdf-3b70-4533-93cb-84d3e9e708d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:17.841028 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.841003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cxc\" (UniqueName: \"kubernetes.io/projected/dcdf5b13-5a41-4647-8b17-ace51441af8d-kube-api-access-w4cxc\") pod \"iptables-alerter-l7kq6\" (UID: \"dcdf5b13-5a41-4647-8b17-ace51441af8d\") " pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:17.841292 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.841272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g8jd\" (UniqueName: \"kubernetes.io/projected/79697ba9-2a2d-4948-8c0f-f2a57ac06857-kube-api-access-2g8jd\") pod \"multus-additional-cni-plugins-fkn2j\" (UID: \"79697ba9-2a2d-4948-8c0f-f2a57ac06857\") " pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:17.843895 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.843864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hk6s\" (UniqueName: \"kubernetes.io/projected/d58961ef-c4ac-48f5-bc94-3df3ba51073e-kube-api-access-9hk6s\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:17.843980 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.843951    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8v5r\" (UniqueName: \"kubernetes.io/projected/0ce6d3aa-0d83-4ade-865f-d37af2041004-kube-api-access-x8v5r\") pod \"node-resolver-b89fz\" (UID: \"0ce6d3aa-0d83-4ade-865f-d37af2041004\") " pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:17.844104 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.844088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdcfq\" (UniqueName: \"kubernetes.io/projected/645836ac-82eb-4693-bb86-4472ce1978d2-kube-api-access-rdcfq\") pod \"multus-pf5kf\" (UID: \"645836ac-82eb-4693-bb86-4472ce1978d2\") " pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:17.845575 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.844820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmnzn\" (UniqueName: \"kubernetes.io/projected/d08b78a3-00ea-45c6-b224-b216247a0002-kube-api-access-tmnzn\") pod \"ovnkube-node-nbls2\" (UID: \"d08b78a3-00ea-45c6-b224-b216247a0002\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:17.880191 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.880124    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:45:17.932564 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.932528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:17.946806 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.946779    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86"
Jul 16 12:45:17.957649 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.957627    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ps2vd"
Jul 16 12:45:17.977938 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.977905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7c9x4"
Jul 16 12:45:17.987147 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:17.987109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pf5kf"
Jul 16 12:45:18.002211 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.002173    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae6cf55f8063ebcd37c44cf473c45a2.slice/crio-ad6d552dd5a9e45494a3d1d539a20e37debcaf53b4b641f9ecf98e497bbd8b06 WatchSource:0}: Error finding container ad6d552dd5a9e45494a3d1d539a20e37debcaf53b4b641f9ecf98e497bbd8b06: Status 404 returned error can't find the container with id ad6d552dd5a9e45494a3d1d539a20e37debcaf53b4b641f9ecf98e497bbd8b06
Jul 16 12:45:18.003021 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.002996    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8137dd54_1895_4825_8bd3_9f1a1c333487.slice/crio-a5972138fbff7291f42cc879aa255780813605a6f708a3db2abb543ce165bac8 WatchSource:0}: Error finding container a5972138fbff7291f42cc879aa255780813605a6f708a3db2abb543ce165bac8: Status 404 returned error can't find the container with id a5972138fbff7291f42cc879aa255780813605a6f708a3db2abb543ce165bac8
Jul 16 12:45:18.008899 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.008871    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:45:18.010681 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.010658    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645836ac_82eb_4693_bb86_4472ce1978d2.slice/crio-834b60a59eb4ba8fb59a255621f6772b83e9952ece23e1687181a7bfb8d0cfc2 WatchSource:0}: Error finding container 834b60a59eb4ba8fb59a255621f6772b83e9952ece23e1687181a7bfb8d0cfc2: Status 404 returned error can't find the container with id 834b60a59eb4ba8fb59a255621f6772b83e9952ece23e1687181a7bfb8d0cfc2
Jul 16 12:45:18.011621 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.011592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7kq6"
Jul 16 12:45:18.011940 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.011919    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d0507dd5f34f08d10a81f149614966.slice/crio-9e11edd515e47c3cb276e4abb1aa493eaae58cfc4992c16e2447c93f59b9bf0d WatchSource:0}: Error finding container 9e11edd515e47c3cb276e4abb1aa493eaae58cfc4992c16e2447c93f59b9bf0d: Status 404 returned error can't find the container with id 9e11edd515e47c3cb276e4abb1aa493eaae58cfc4992c16e2447c93f59b9bf0d
Jul 16 12:45:18.015248 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.015224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b89fz"
Jul 16 12:45:18.023104 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.023079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdf5b13_5a41_4647_8b17_ace51441af8d.slice/crio-31e4ec9ffd80dd64524bf709ae80bafa791a3308c172c0bb9ea5f35790635233 WatchSource:0}: Error finding container 31e4ec9ffd80dd64524bf709ae80bafa791a3308c172c0bb9ea5f35790635233: Status 404 returned error can't find the container with id 31e4ec9ffd80dd64524bf709ae80bafa791a3308c172c0bb9ea5f35790635233
Jul 16 12:45:18.025510 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.025489    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce6d3aa_0d83_4ade_865f_d37af2041004.slice/crio-929d7d386a6cf18ebbe8374d6f2e2f4940e8b1e990b15bac3e1006f4f9968f81 WatchSource:0}: Error finding container 929d7d386a6cf18ebbe8374d6f2e2f4940e8b1e990b15bac3e1006f4f9968f81: Status 404 returned error can't find the container with id 929d7d386a6cf18ebbe8374d6f2e2f4940e8b1e990b15bac3e1006f4f9968f81
Jul 16 12:45:18.044570 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.044548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkn2j"
Jul 16 12:45:18.049758 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.049743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:18.053877 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.053854    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79697ba9_2a2d_4948_8c0f_f2a57ac06857.slice/crio-d7d7f6e7aa52a644399bd4a925a05b3861011e58731f0dfea67f8a9b239ee163 WatchSource:0}: Error finding container d7d7f6e7aa52a644399bd4a925a05b3861011e58731f0dfea67f8a9b239ee163: Status 404 returned error can't find the container with id d7d7f6e7aa52a644399bd4a925a05b3861011e58731f0dfea67f8a9b239ee163
Jul 16 12:45:18.058511 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.058490    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08b78a3_00ea_45c6_b224_b216247a0002.slice/crio-98f591e7161b26e74ebfee101907e4b0607c63845bda068f455b0438d917c23d WatchSource:0}: Error finding container 98f591e7161b26e74ebfee101907e4b0607c63845bda068f455b0438d917c23d: Status 404 returned error can't find the container with id 98f591e7161b26e74ebfee101907e4b0607c63845bda068f455b0438d917c23d
Jul 16 12:45:18.221959 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.221869    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:45:18.333226 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.333191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:18.333393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.333237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:18.333393 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.333343    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:18.333393 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.333351    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:18.333494 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.333395    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret podName:37e50b87-c3e2-45fb-8c7e-7fd07471b20e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:19.333381956 +0000 UTC m=+3.072371728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret") pod "global-pull-secret-syncer-qc2j4" (UID: "37e50b87-c3e2-45fb-8c7e-7fd07471b20e") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:18.333494 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.333411    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs podName:d58961ef-c4ac-48f5-bc94-3df3ba51073e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:19.333403657 +0000 UTC m=+3.072393415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs") pod "network-metrics-daemon-pzs8z" (UID: "d58961ef-c4ac-48f5-bc94-3df3ba51073e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:18.355281 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.355256    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecee6e5_846a_40a8_9e97_4a3b4e81b94e.slice/crio-3d280bdd479a625f2887e5041776e32cb7866317e0122c1aaf4833d206f5f72a WatchSource:0}: Error finding container 3d280bdd479a625f2887e5041776e32cb7866317e0122c1aaf4833d206f5f72a: Status 404 returned error can't find the container with id 3d280bdd479a625f2887e5041776e32cb7866317e0122c1aaf4833d206f5f72a
Jul 16 12:45:18.401772 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:18.401742    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cc2ad0_bf5b_4396_8e25_40dde49480e9.slice/crio-0a1e4c0bdf3d1eba3fda4fb468e57be5ce577a461cc821d1711106127eb7ad61 WatchSource:0}: Error finding container 0a1e4c0bdf3d1eba3fda4fb468e57be5ce577a461cc821d1711106127eb7ad61: Status 404 returned error can't find the container with id 0a1e4c0bdf3d1eba3fda4fb468e57be5ce577a461cc821d1711106127eb7ad61
Jul 16 12:45:18.434443 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.434415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:18.434605 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.434588    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:45:18.434704 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.434610    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:45:18.434704 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.434620    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dpz55 for pod openshift-network-diagnostics/network-check-target-4ww9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:18.434704 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:18.434671    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55 podName:66ad8bdf-3b70-4533-93cb-84d3e9e708d3 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:19.434656836 +0000 UTC m=+3.173646599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dpz55" (UniqueName: "kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55") pod "network-check-target-4ww9t" (UID: "66ad8bdf-3b70-4533-93cb-84d3e9e708d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:18.687811 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.687691    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:40:17 +0000 UTC" deadline="2028-04-09 12:59:21.376175596 +0000 UTC"
Jul 16 12:45:18.687811 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.687757    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15192h14m2.68842359s"
Jul 16 12:45:18.802296 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.802024    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:45:18.835766 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.835674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7kq6" event={"ID":"dcdf5b13-5a41-4647-8b17-ace51441af8d","Type":"ContainerStarted","Data":"31e4ec9ffd80dd64524bf709ae80bafa791a3308c172c0bb9ea5f35790635233"}
Jul 16 12:45:18.839089 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.839058    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf5kf" event={"ID":"645836ac-82eb-4693-bb86-4472ce1978d2","Type":"ContainerStarted","Data":"834b60a59eb4ba8fb59a255621f6772b83e9952ece23e1687181a7bfb8d0cfc2"}
Jul 16 12:45:18.851552 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.851517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7c9x4" event={"ID":"8137dd54-1895-4825-8bd3-9f1a1c333487","Type":"ContainerStarted","Data":"a5972138fbff7291f42cc879aa255780813605a6f708a3db2abb543ce165bac8"}
Jul 16 12:45:18.862986 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.862904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"5ae6cf55f8063ebcd37c44cf473c45a2","Type":"ContainerStarted","Data":"ad6d552dd5a9e45494a3d1d539a20e37debcaf53b4b641f9ecf98e497bbd8b06"}
Jul 16 12:45:18.870356 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.870324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerStarted","Data":"d7d7f6e7aa52a644399bd4a925a05b3861011e58731f0dfea67f8a9b239ee163"}
Jul 16 12:45:18.877266 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.877237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b89fz" event={"ID":"0ce6d3aa-0d83-4ade-865f-d37af2041004","Type":"ContainerStarted","Data":"929d7d386a6cf18ebbe8374d6f2e2f4940e8b1e990b15bac3e1006f4f9968f81"}
Jul 16 12:45:18.880808 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.880778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" event={"ID":"62d0507dd5f34f08d10a81f149614966","Type":"ContainerStarted","Data":"9e11edd515e47c3cb276e4abb1aa493eaae58cfc4992c16e2447c93f59b9bf0d"}
Jul 16 12:45:18.890946 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.890917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86" event={"ID":"31cc2ad0-bf5b-4396-8e25-40dde49480e9","Type":"ContainerStarted","Data":"0a1e4c0bdf3d1eba3fda4fb468e57be5ce577a461cc821d1711106127eb7ad61"}
Jul 16 12:45:18.895138 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.895108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fvbf" event={"ID":"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e","Type":"ContainerStarted","Data":"3d280bdd479a625f2887e5041776e32cb7866317e0122c1aaf4833d206f5f72a"}
Jul 16 12:45:18.905777 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:18.905748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"98f591e7161b26e74ebfee101907e4b0607c63845bda068f455b0438d917c23d"}
Jul 16 12:45:19.345432 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.345382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:19.345620 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.345449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:19.345703 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.345616    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:19.345703 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.345679    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret podName:37e50b87-c3e2-45fb-8c7e-7fd07471b20e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:21.345660592 +0000 UTC m=+5.084650354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret") pod "global-pull-secret-syncer-qc2j4" (UID: "37e50b87-c3e2-45fb-8c7e-7fd07471b20e") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:19.346068 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.345951    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:19.346068 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.346018    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs podName:d58961ef-c4ac-48f5-bc94-3df3ba51073e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:21.346000164 +0000 UTC m=+5.084989946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs") pod "network-metrics-daemon-pzs8z" (UID: "d58961ef-c4ac-48f5-bc94-3df3ba51073e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:19.446412 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.446372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:19.446622 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.446569    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:45:19.446622 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.446596    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:45:19.446622 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.446610    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dpz55 for pod openshift-network-diagnostics/network-check-target-4ww9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:19.446804 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.446673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55 podName:66ad8bdf-3b70-4533-93cb-84d3e9e708d3 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:21.44665392 +0000 UTC m=+5.185643694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dpz55" (UniqueName: "kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55") pod "network-check-target-4ww9t" (UID: "66ad8bdf-3b70-4533-93cb-84d3e9e708d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:19.688399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.688300    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:40:17 +0000 UTC" deadline="2028-04-04 05:25:34.00946071 +0000 UTC"
Jul 16 12:45:19.688399 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.688346    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15064h40m14.321119467s"
Jul 16 12:45:19.828255 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.828031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:19.828255 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.828232    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:19.828501 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.828445    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:19.828562 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.828539    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:19.828618 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:19.828611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:19.828747 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:19.828683    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:21.367614 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:21.367547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:21.368244 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:21.367650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:21.368244 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.367794    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:21.368244 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.367861    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs podName:d58961ef-c4ac-48f5-bc94-3df3ba51073e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:25.367840328 +0000 UTC m=+9.106830095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs") pod "network-metrics-daemon-pzs8z" (UID: "d58961ef-c4ac-48f5-bc94-3df3ba51073e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:21.368441 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.368315    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:21.368441 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.368374    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret podName:37e50b87-c3e2-45fb-8c7e-7fd07471b20e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:25.368356069 +0000 UTC m=+9.107345843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret") pod "global-pull-secret-syncer-qc2j4" (UID: "37e50b87-c3e2-45fb-8c7e-7fd07471b20e") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:21.468412 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:21.468371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:21.468594 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.468565    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:45:21.468594 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.468593    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:45:21.468706 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.468608    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dpz55 for pod openshift-network-diagnostics/network-check-target-4ww9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:21.468706 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.468674    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55 podName:66ad8bdf-3b70-4533-93cb-84d3e9e708d3 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:25.468655931 +0000 UTC m=+9.207645702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dpz55" (UniqueName: "kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55") pod "network-check-target-4ww9t" (UID: "66ad8bdf-3b70-4533-93cb-84d3e9e708d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:21.828450 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:21.828244    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:21.828450 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.828413    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:21.828692 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:21.828520    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:21.828692 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.828628    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:21.828692 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:21.828671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:21.828862 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:21.828740    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:23.828206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:23.828160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:23.828206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:23.828182    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:23.828206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:23.828182    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:23.828750 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:23.828317    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:23.828750 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:23.828404    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:23.828750 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:23.828469    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:25.400658 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:25.400399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:25.400658 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:25.400511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:25.400658 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.400659    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:25.401229 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.400731    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs podName:d58961ef-c4ac-48f5-bc94-3df3ba51073e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:33.4007112 +0000 UTC m=+17.139700977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs") pod "network-metrics-daemon-pzs8z" (UID: "d58961ef-c4ac-48f5-bc94-3df3ba51073e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:25.401229 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.400767    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:25.401229 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.400828    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret podName:37e50b87-c3e2-45fb-8c7e-7fd07471b20e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:33.400810422 +0000 UTC m=+17.139800197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret") pod "global-pull-secret-syncer-qc2j4" (UID: "37e50b87-c3e2-45fb-8c7e-7fd07471b20e") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:25.501762 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:25.501102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:25.501762 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.501344    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:45:25.501762 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.501363    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:45:25.501762 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.501376    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dpz55 for pod openshift-network-diagnostics/network-check-target-4ww9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:25.501762 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.501437    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55 podName:66ad8bdf-3b70-4533-93cb-84d3e9e708d3 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:33.501421193 +0000 UTC m=+17.240410966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dpz55" (UniqueName: "kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55") pod "network-check-target-4ww9t" (UID: "66ad8bdf-3b70-4533-93cb-84d3e9e708d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:25.828243 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:25.828165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:25.828405 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.828268    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:25.828859 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:25.828666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:25.828859 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:25.828674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:25.828859 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.828794    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:25.829087 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:25.828887    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:27.827715 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:27.827675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:27.828223 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:27.827686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:27.828223 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:27.827808    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:27.828223 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:27.827871    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:27.828223 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:27.827684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:27.828223 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:27.827961    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:29.828699 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:29.828654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:29.828699 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:29.828700    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:29.829245 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:29.828696    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:29.829245 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:29.828803    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:29.829245 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:29.828865    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:29.829245 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:29.828930    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:31.828682 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:31.828638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:31.828682 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:31.828670    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:31.829231 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:31.828757    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:31.829231 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:31.828769    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:31.829231 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:31.828829    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:31.829231 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:31.828899    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:33.465350 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:33.465311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:33.465350 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:33.465360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:33.465769 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.465463    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:33.465769 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.465466    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:33.465769 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.465530    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret podName:37e50b87-c3e2-45fb-8c7e-7fd07471b20e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:49.46551162 +0000 UTC m=+33.204501380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret") pod "global-pull-secret-syncer-qc2j4" (UID: "37e50b87-c3e2-45fb-8c7e-7fd07471b20e") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:33.465769 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.465546    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs podName:d58961ef-c4ac-48f5-bc94-3df3ba51073e nodeName:}" failed. No retries permitted until 2026-07-16 12:45:49.465539268 +0000 UTC m=+33.204529024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs") pod "network-metrics-daemon-pzs8z" (UID: "d58961ef-c4ac-48f5-bc94-3df3ba51073e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:33.565818 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:33.565782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:33.565987 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.565941    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:45:33.565987 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.565965    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:45:33.565987 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.565975    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dpz55 for pod openshift-network-diagnostics/network-check-target-4ww9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:33.566139 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.566031    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55 podName:66ad8bdf-3b70-4533-93cb-84d3e9e708d3 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:49.566011294 +0000 UTC m=+33.305001056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dpz55" (UniqueName: "kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55") pod "network-check-target-4ww9t" (UID: "66ad8bdf-3b70-4533-93cb-84d3e9e708d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:33.828465 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:33.828392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:33.828598 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:33.828392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:33.828598 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.828516    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:33.828598 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:33.828522    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:33.828749 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.828599    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:33.828749 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:33.828695    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:35.828583 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:35.828392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:35.828954 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:35.828402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:35.828954 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:35.828665    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:35.828954 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:35.828760    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:35.828954 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:35.828435    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:35.828954 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:35.828866    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:35.957428 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:35.957334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" event={"ID":"62d0507dd5f34f08d10a81f149614966","Type":"ContainerStarted","Data":"b586f3fc3ab235ed458c34ebee16ed60fd3e83620073dac374d4c740d362d173"}
Jul 16 12:45:35.964393 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:35.964228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ps2vd" event={"ID":"499b9624-7914-491b-8f60-5ca24c01a2bc","Type":"ContainerStarted","Data":"3535a2ac243a56dc27a5e69575d09b34da5a9104608131a9f9df18ef4c8de6c8"}
Jul 16 12:45:35.972460 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:35.972225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf5kf" event={"ID":"645836ac-82eb-4693-bb86-4472ce1978d2","Type":"ContainerStarted","Data":"21315ff7b07094e2447808914b41d1a7431e373a1ab15464eda0d884db014bc9"}
Jul 16 12:45:35.982502 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:35.982422    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" podStartSLOduration=18.982401426 podStartE2EDuration="18.982401426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:35.981993096 +0000 UTC m=+19.720982874" watchObservedRunningTime="2026-07-16 12:45:35.982401426 +0000 UTC m=+19.721391203"
Jul 16 12:45:36.014184 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.014099    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pf5kf" podStartSLOduration=1.504573622 podStartE2EDuration="19.014077806s" totalImagesPullingTime="17.509504184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:36.013360513 +0000 UTC m=+19.752350295" watchObservedRunningTime="2026-07-16 12:45:36.014077806 +0000 UTC m=+19.753067585"
Jul 16 12:45:36.945303 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.944944    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 12:45:36.976647 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.976612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86" event={"ID":"31cc2ad0-bf5b-4396-8e25-40dde49480e9","Type":"ContainerStarted","Data":"c516187544a6d28026611d29be9d40b4ec3a38009f04f74e98af183717c1de1b"}
Jul 16 12:45:36.976796 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.976679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86" event={"ID":"31cc2ad0-bf5b-4396-8e25-40dde49480e9","Type":"ContainerStarted","Data":"0cc4bd6ba7799027a2204be7480fe07edaad0ae960ff222f16c2f8f4f8800a13"}
Jul 16 12:45:36.978120 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.978077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fvbf" event={"ID":"3ecee6e5-846a-40a8-9e97-4a3b4e81b94e","Type":"ContainerStarted","Data":"7f1ca3c3a63eab49a1d36a1f12bb4c5dcea7c771d5211c1a5525315467e72cc7"}
Jul 16 12:45:36.981450 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.981429    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"778743804f8b09ab93ef9265b5a788a3f69b282efbd467947bd03af1de1b5126"}
Jul 16 12:45:36.981540 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.981502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"e76ab29751a0acc717dc81f66ddcd04b94d0226439a367f0fa3c56e9cc15c64a"}
Jul 16 12:45:36.981593 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.981553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"2db947d5f12078980b8fc7fb4ec7a19eb6d364c97b70ae14e15cad8a29b454ce"}
Jul 16 12:45:36.981655 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.981601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"d300a2ece24441d205068e1bcddeb624b41744532dd4ca50917911b0f1905915"}
Jul 16 12:45:36.981655 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.981644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"8e3e5ab95403390de35832cd2a5ac9eb51a383526b8488c4896d36fecd4bd4ea"}
Jul 16 12:45:36.981754 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.981688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"bc941412e3fe90c9ca6e530c19890c5d133e7075a7d0e4c7fb9534d67ec6f292"}
Jul 16 12:45:36.983101 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.983072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7kq6" event={"ID":"dcdf5b13-5a41-4647-8b17-ace51441af8d","Type":"ContainerStarted","Data":"9120fa1905218f81c4fdabfcfecfa6dc58cdbc14b6e31f7129a3640d0b574b6a"}
Jul 16 12:45:36.984571 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.984546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7c9x4" event={"ID":"8137dd54-1895-4825-8bd3-9f1a1c333487","Type":"ContainerStarted","Data":"92bfc4eabec33754048bc6bf23dc4287923a87b38cde0b451a271ae222c68b7c"}
Jul 16 12:45:36.986055 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.986032    2564 generic.go:356] "Generic (PLEG): container finished" podID="5ae6cf55f8063ebcd37c44cf473c45a2" containerID="8bbb2a42bfb4a1a4ad30fe863e499883efbf4bbf92bba489fadef443e3486d32" exitCode=0
Jul 16 12:45:36.986195 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.986103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"5ae6cf55f8063ebcd37c44cf473c45a2","Type":"ContainerDied","Data":"8bbb2a42bfb4a1a4ad30fe863e499883efbf4bbf92bba489fadef443e3486d32"}
Jul 16 12:45:36.987819 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.987787    2564 generic.go:356] "Generic (PLEG): container finished" podID="79697ba9-2a2d-4948-8c0f-f2a57ac06857" containerID="a902a7d8276649dde1a28804434a562929e63e35f12e3f1ea03ebf5e96d0ec53" exitCode=0
Jul 16 12:45:36.987917 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.987873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerDied","Data":"a902a7d8276649dde1a28804434a562929e63e35f12e3f1ea03ebf5e96d0ec53"}
Jul 16 12:45:36.990838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.990814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b89fz" event={"ID":"0ce6d3aa-0d83-4ade-865f-d37af2041004","Type":"ContainerStarted","Data":"bc544b9d8605f4beebc24f1cb62c8242376a51f722e6d1c95fb43064f9e57e13"}
Jul 16 12:45:36.999192 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:36.999150    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7fvbf" podStartSLOduration=2.856096857 podStartE2EDuration="19.99913448s" totalImagesPullingTime="17.143037623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:36.999082658 +0000 UTC m=+20.738072436" watchObservedRunningTime="2026-07-16 12:45:36.99913448 +0000 UTC m=+20.738124256"
Jul 16 12:45:37.022096 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.022043    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b89fz" podStartSLOduration=2.5488409560000003 podStartE2EDuration="20.022025726s" totalImagesPullingTime="17.47318477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:37.021929616 +0000 UTC m=+20.760919408" watchObservedRunningTime="2026-07-16 12:45:37.022025726 +0000 UTC m=+20.761015504"
Jul 16 12:45:37.040511 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.040471    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l7kq6" podStartSLOduration=2.565020893 podStartE2EDuration="20.040454358s" totalImagesPullingTime="17.475433465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:37.040226116 +0000 UTC m=+20.779215895" watchObservedRunningTime="2026-07-16 12:45:37.040454358 +0000 UTC m=+20.779444148"
Jul 16 12:45:37.106236 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.106097    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7c9x4" podStartSLOduration=2.592774735 podStartE2EDuration="20.106080133s" totalImagesPullingTime="17.513305398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:37.105609305 +0000 UTC m=+20.844599086" watchObservedRunningTime="2026-07-16 12:45:37.106080133 +0000 UTC m=+20.845069909"
Jul 16 12:45:37.214233 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.214193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:37.363895 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.363810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:37.462696 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.462661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:37.568139 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.568093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:37.701492 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.701335    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T12:45:36.94530133Z","UUID":"18b33825-7bba-4b29-a0db-1902c896afdb","Handler":null,"Name":"","Endpoint":""}
Jul 16 12:45:37.705290 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.704401    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 12:45:37.705290 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.704454    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 12:45:37.828020 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.827910    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:37.828207 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:37.828071    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:37.828536 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.828303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:37.828536 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.827922    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:37.828536 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:37.828418    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:37.828536 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:37.828498    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:37.995591 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.995482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"5ae6cf55f8063ebcd37c44cf473c45a2","Type":"ContainerStarted","Data":"07bc409f3561fe44ada9ac52cac2f24b1a6cc41e717b58593b2fbb4384247d81"}
Jul 16 12:45:37.998319 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:37.998288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86" event={"ID":"31cc2ad0-bf5b-4396-8e25-40dde49480e9","Type":"ContainerStarted","Data":"52a1d3ef4393da683272e6c17351361f4caf20feaf3ca7e8af2abf7292a73dd7"}
Jul 16 12:45:38.018571 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:38.018518    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" podStartSLOduration=21.018498924 podStartE2EDuration="21.018498924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:38.017744436 +0000 UTC m=+21.756734215" watchObservedRunningTime="2026-07-16 12:45:38.018498924 +0000 UTC m=+21.757488715"
Jul 16 12:45:38.044164 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:38.044090    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thg86" podStartSLOduration=2.400412485 podStartE2EDuration="21.044062789s" totalImagesPullingTime="18.643650304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:38.043526371 +0000 UTC m=+21.782516150" watchObservedRunningTime="2026-07-16 12:45:38.044062789 +0000 UTC m=+21.783052571"
Jul 16 12:45:38.375076 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:38.374915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:38.702218 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:38.702143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:38.841653 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:38.841616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:39.828348 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:39.828316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:39.828962 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:39.828443    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:39.828962 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:39.828578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:39.828962 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:39.828660    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:39.828962 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:39.828710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:39.828962 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:39.828792    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:41.545602 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:41.545549    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:41.546322 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:41.546299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:41.828089 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:41.828012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:41.828089 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:41.828050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:41.828089 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:41.828050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:41.828375 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:41.828164    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:41.828375 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:41.828238    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:41.828375 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:41.828320    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:42.007539 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:42.007507    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:42.008001 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:42.007984    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7fvbf"
Jul 16 12:45:42.103051 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:42.102970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:43.011200 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.011122    2564 generic.go:356] "Generic (PLEG): container finished" podID="79697ba9-2a2d-4948-8c0f-f2a57ac06857" containerID="dd71efb9b4fae00036e2e2d7c01abc7662ea43b38fbe2a560e76c91394ef7fd2" exitCode=0
Jul 16 12:45:43.011631 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.011205    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerDied","Data":"dd71efb9b4fae00036e2e2d7c01abc7662ea43b38fbe2a560e76c91394ef7fd2"}
Jul 16 12:45:43.012771 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.012745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ps2vd" event={"ID":"499b9624-7914-491b-8f60-5ca24c01a2bc","Type":"ContainerStarted","Data":"d32d98dc6d8da83796305b1d47efd52b3be4d3c55edc9e297c9fcc3d12d03bdf"}
Jul 16 12:45:43.015737 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.015720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"42e33d3d29d5da2e82fee34c67087e43d17fc50a5e7b14c3483e670af9d4bffd"}
Jul 16 12:45:43.057625 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.057582    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ps2vd" podStartSLOduration=19.207209526 podStartE2EDuration="26.057568317s" totalImagesPullingTime="6.850358791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:43.057557374 +0000 UTC m=+26.796547175" watchObservedRunningTime="2026-07-16 12:45:43.057568317 +0000 UTC m=+26.796558095"
Jul 16 12:45:43.828635 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.828601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:43.828778 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.828606    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:43.828778 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:43.828699    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:43.828778 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:43.828722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:43.828894 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:43.828795    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:43.828928 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:43.828893    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:44.109034 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:44.109011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:45.021013 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.020981    2564 generic.go:356] "Generic (PLEG): container finished" podID="79697ba9-2a2d-4948-8c0f-f2a57ac06857" containerID="9a9579c0def2e7e21c51bd02453cf83863b0a9b7a06e63d467dff27101a84ac4" exitCode=0
Jul 16 12:45:45.021192 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.021052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerDied","Data":"9a9579c0def2e7e21c51bd02453cf83863b0a9b7a06e63d467dff27101a84ac4"}
Jul 16 12:45:45.024552 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.024530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" event={"ID":"d08b78a3-00ea-45c6-b224-b216247a0002","Type":"ContainerStarted","Data":"f41a2eb0e2b6f72b01081c25b2fe18ff61cb50ab940156998173db9dc3b0c186"}
Jul 16 12:45:45.024790 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.024768    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:45.024879 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.024841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:45.040441 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.040420    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:45.086918 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.086877    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2" podStartSLOduration=10.197859185 podStartE2EDuration="28.086864055s" totalImagesPullingTime="17.88900487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:45.086375389 +0000 UTC m=+28.825365167" watchObservedRunningTime="2026-07-16 12:45:45.086864055 +0000 UTC m=+28.825853833"
Jul 16 12:45:45.828406 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.828010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:45.829394 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:45.828494    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:45.829394 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.828304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:45.829394 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:45.828612    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:45.829394 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:45.828255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:45.829394 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:45.828702    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:46.028879 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:46.028773    2564 generic.go:356] "Generic (PLEG): container finished" podID="79697ba9-2a2d-4948-8c0f-f2a57ac06857" containerID="4ce37cc44538ccf63263970249523e3687a907f35f74cdc50eec50bfb10e4a8a" exitCode=0
Jul 16 12:45:46.028879 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:46.028852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerDied","Data":"4ce37cc44538ccf63263970249523e3687a907f35f74cdc50eec50bfb10e4a8a"}
Jul 16 12:45:46.029390 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:46.029369    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:46.044066 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:46.044045    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:45:46.998535 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:46.998477    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qc2j4"]
Jul 16 12:45:46.999004 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:46.998614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:46.999004 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:46.998713    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:47.001592 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:47.001523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pzs8z"]
Jul 16 12:45:47.001839 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:47.001651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:47.001839 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:47.001788    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:47.002350 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:47.002329    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ww9t"]
Jul 16 12:45:47.002472 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:47.002421    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:47.002531 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:47.002505    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:48.828701 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:48.828633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:48.828701 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:48.828674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:48.829329 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:48.828633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:48.829329 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:48.828779    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:48.829329 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:48.828890    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:48.829329 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:48.828998    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:49.482876 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:49.482847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:49.483067 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:49.482883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:49.483067 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.482997    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:49.483067 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.483055    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret podName:37e50b87-c3e2-45fb-8c7e-7fd07471b20e nodeName:}" failed. No retries permitted until 2026-07-16 12:46:21.483041272 +0000 UTC m=+65.222031028 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret") pod "global-pull-secret-syncer-qc2j4" (UID: "37e50b87-c3e2-45fb-8c7e-7fd07471b20e") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:45:49.483253 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.482998    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:49.483253 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.483171    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs podName:d58961ef-c4ac-48f5-bc94-3df3ba51073e nodeName:}" failed. No retries permitted until 2026-07-16 12:46:21.483152779 +0000 UTC m=+65.222142550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs") pod "network-metrics-daemon-pzs8z" (UID: "d58961ef-c4ac-48f5-bc94-3df3ba51073e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:45:49.584096 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:49.584061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:49.584282 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.584246    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:45:49.584282 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.584270    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:45:49.584282 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.584284    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dpz55 for pod openshift-network-diagnostics/network-check-target-4ww9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:49.584448 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:49.584341    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55 podName:66ad8bdf-3b70-4533-93cb-84d3e9e708d3 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:21.584317102 +0000 UTC m=+65.323306859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dpz55" (UniqueName: "kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55") pod "network-check-target-4ww9t" (UID: "66ad8bdf-3b70-4533-93cb-84d3e9e708d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:45:50.504742 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:50.504712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:50.604847 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:50.604802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:50.702086 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:50.702057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:50.828672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:50.828474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:50.828832 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:50.828474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:50.828832 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:50.828753    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:50.828832 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:50.828484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:50.828832 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:50.828822    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:50.829018 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:50.828932    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:51.043934 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:51.043843    2564 generic.go:356] "Generic (PLEG): container finished" podID="79697ba9-2a2d-4948-8c0f-f2a57ac06857" containerID="5a2fcfa5b31e58652daa3626360ec17f4a6f9813c29fcb836224217fc68fe82a" exitCode=0
Jul 16 12:45:51.043934 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:51.043902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerDied","Data":"5a2fcfa5b31e58652daa3626360ec17f4a6f9813c29fcb836224217fc68fe82a"}
Jul 16 12:45:52.049360 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:52.049325    2564 generic.go:356] "Generic (PLEG): container finished" podID="79697ba9-2a2d-4948-8c0f-f2a57ac06857" containerID="d74db731a641affa293394a03e1b0ca10b7e27731834752e0a09590150a3ac2d" exitCode=0
Jul 16 12:45:52.049816 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:52.049369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerDied","Data":"d74db731a641affa293394a03e1b0ca10b7e27731834752e0a09590150a3ac2d"}
Jul 16 12:45:52.828063 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:52.828038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:52.828277 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:52.828038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:52.828277 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:52.828160    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:52.828277 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:52.828048    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:52.828447 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:52.828298    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:52.828447 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:52.828211    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:52.937730 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:52.937657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:53.054379 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:53.054347    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" event={"ID":"79697ba9-2a2d-4948-8c0f-f2a57ac06857","Type":"ContainerStarted","Data":"5fbb151cc224f47161bcd3e36680de135cc3a388ceb73ec933b615cc6678dd83"}
Jul 16 12:45:53.082308 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:53.082259    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fkn2j" podStartSLOduration=6.93290373 podStartE2EDuration="36.082240294s" totalImagesPullingTime="29.149336564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:45:53.080668858 +0000 UTC m=+36.819658637" watchObservedRunningTime="2026-07-16 12:45:53.082240294 +0000 UTC m=+36.821230073"
Jul 16 12:45:54.372933 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.372900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:54.433377 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.433342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:54.703373 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.703293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:54.804796 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.804756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:54.827901 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.827875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:54.828065 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.827900    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:54.828065 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.827878    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:54.828065 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:54.828019    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzs8z" podUID="d58961ef-c4ac-48f5-bc94-3df3ba51073e"
Jul 16 12:45:54.828232 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:54.828126    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qc2j4" podUID="37e50b87-c3e2-45fb-8c7e-7fd07471b20e"
Jul 16 12:45:54.828232 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:54.828195    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ww9t" podUID="66ad8bdf-3b70-4533-93cb-84d3e9e708d3"
Jul 16 12:45:54.983568 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:54.983477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:55.104548 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:55.104514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:55.284373 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:55.284287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:55.408867 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:55.408837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:55.683370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:55.683284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:55.781099 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:55.781063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:56.579135 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.579032    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeReady"
Jul 16 12:45:56.579711 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.579192    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 12:45:56.650269 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.650227    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jt7hf"]
Jul 16 12:45:56.684944 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.684912    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h882t"]
Jul 16 12:45:56.685139 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.685061    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.687682 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.687661    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 12:45:56.687682 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.687679    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lnsbk\""
Jul 16 12:45:56.687849 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.687685    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 12:45:56.701514 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.701495    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b89fz_0ce6d3aa-0d83-4ade-865f-d37af2041004/dns-node-resolver/0.log"
Jul 16 12:45:56.711064 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.711043    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jt7hf"]
Jul 16 12:45:56.711201 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.711076    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h882t"]
Jul 16 12:45:56.711201 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.711090    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-68f8v"]
Jul 16 12:45:56.711201 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.711193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:56.715805 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.714890    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 12:45:56.715805 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.715355    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 12:45:56.715805 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.715513    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 12:45:56.716036 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.715946    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wlnmp\""
Jul 16 12:45:56.729420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.729398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-68f8v"]
Jul 16 12:45:56.729567 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.729486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.732537 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.732517    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 12:45:56.732690 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.732674    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 12:45:56.732835 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.732818    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 12:45:56.732872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.732843    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g9fmr\""
Jul 16 12:45:56.733020 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.733002    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 12:45:56.831263 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.831194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:45:56.831396 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.831293    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:45:56.831396 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.831316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:45:56.833916 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.833895    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 12:45:56.834074 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.833922    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 12:45:56.834074 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.833982    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 12:45:56.834074 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.834044    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 12:45:56.834311 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.834293    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sbdj2\""
Jul 16 12:45:56.834389 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.834375    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xrlr5\""
Jul 16 12:45:56.842353 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.842463 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdda2b5b-0eec-4991-864d-10550483dc57-data-volume\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.842463 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mhh\" (UniqueName: \"kubernetes.io/projected/7efedfaf-ec54-49bc-ba3c-08bb873abd11-kube-api-access-r8mhh\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.842548 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdda2b5b-0eec-4991-864d-10550483dc57-crio-socket\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.842548 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7efedfaf-ec54-49bc-ba3c-08bb873abd11-config-volume\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.842548 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjpx8\" (UniqueName: \"kubernetes.io/projected/a8539430-4cf2-4ec5-8f2e-f285fade1f8d-kube-api-access-sjpx8\") pod \"ingress-canary-h882t\" (UID: \"a8539430-4cf2-4ec5-8f2e-f285fade1f8d\") " pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:56.842548 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8539430-4cf2-4ec5-8f2e-f285fade1f8d-cert\") pod \"ingress-canary-h882t\" (UID: \"a8539430-4cf2-4ec5-8f2e-f285fade1f8d\") " pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:56.842683 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.842683 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.842683 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vkr4\" (UniqueName: \"kubernetes.io/projected/bdda2b5b-0eec-4991-864d-10550483dc57-kube-api-access-6vkr4\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.842683 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.842678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7efedfaf-ec54-49bc-ba3c-08bb873abd11-tmp-dir\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.915305 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.915255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:56.943188 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.943319 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdda2b5b-0eec-4991-864d-10550483dc57-data-volume\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.943319 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mhh\" (UniqueName: \"kubernetes.io/projected/7efedfaf-ec54-49bc-ba3c-08bb873abd11-kube-api-access-r8mhh\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.943407 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:56.943329    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 12:45:56.943407 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:56.943391    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:57.443373745 +0000 UTC m=+41.182363519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : secret "insights-runtime-extractor-tls" not found
Jul 16 12:45:56.943512 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdda2b5b-0eec-4991-864d-10550483dc57-crio-socket\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.943567 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7efedfaf-ec54-49bc-ba3c-08bb873abd11-config-volume\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.943567 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdda2b5b-0eec-4991-864d-10550483dc57-data-volume\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.943660 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjpx8\" (UniqueName: \"kubernetes.io/projected/a8539430-4cf2-4ec5-8f2e-f285fade1f8d-kube-api-access-sjpx8\") pod \"ingress-canary-h882t\" (UID: \"a8539430-4cf2-4ec5-8f2e-f285fade1f8d\") " pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:56.943660 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8539430-4cf2-4ec5-8f2e-f285fade1f8d-cert\") pod \"ingress-canary-h882t\" (UID: \"a8539430-4cf2-4ec5-8f2e-f285fade1f8d\") " pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:56.943756 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.943756 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdda2b5b-0eec-4991-864d-10550483dc57-crio-socket\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.943756 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.943921 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vkr4\" (UniqueName: \"kubernetes.io/projected/bdda2b5b-0eec-4991-864d-10550483dc57-kube-api-access-6vkr4\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:56.943921 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.943808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7efedfaf-ec54-49bc-ba3c-08bb873abd11-tmp-dir\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.943921 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:56.943835    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 12:45:56.943921 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:56.943894    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:57.443878498 +0000 UTC m=+41.182868271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : configmap "kube-rbac-proxy" not found
Jul 16 12:45:56.943921 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:56.943896    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 12:45:56.944199 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:56.943964    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls podName:7efedfaf-ec54-49bc-ba3c-08bb873abd11 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:57.443949761 +0000 UTC m=+41.182939525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls") pod "dns-default-jt7hf" (UID: "7efedfaf-ec54-49bc-ba3c-08bb873abd11") : secret "dns-default-metrics-tls" not found
Jul 16 12:45:56.944199 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.944142    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7efedfaf-ec54-49bc-ba3c-08bb873abd11-tmp-dir\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.944283 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.944195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7efedfaf-ec54-49bc-ba3c-08bb873abd11-config-volume\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.947543 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.947519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8539430-4cf2-4ec5-8f2e-f285fade1f8d-cert\") pod \"ingress-canary-h882t\" (UID: \"a8539430-4cf2-4ec5-8f2e-f285fade1f8d\") " pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:56.955532 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.955506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mhh\" (UniqueName: \"kubernetes.io/projected/7efedfaf-ec54-49bc-ba3c-08bb873abd11-kube-api-access-r8mhh\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:56.955635 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.955537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjpx8\" (UniqueName: \"kubernetes.io/projected/a8539430-4cf2-4ec5-8f2e-f285fade1f8d-kube-api-access-sjpx8\") pod \"ingress-canary-h882t\" (UID: \"a8539430-4cf2-4ec5-8f2e-f285fade1f8d\") " pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:56.955838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:56.955819    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vkr4\" (UniqueName: \"kubernetes.io/projected/bdda2b5b-0eec-4991-864d-10550483dc57-kube-api-access-6vkr4\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:57.019041 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.019012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:57.021780 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.021763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h882t"
Jul 16 12:45:57.228018 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.227556    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h882t"]
Jul 16 12:45:57.230596 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:57.230566    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8539430_4cf2_4ec5_8f2e_f285fade1f8d.slice/crio-402b9d44dcbad4821ffc881830a425e7b8a9faf4b7d30102b97b51fc18446c32 WatchSource:0}: Error finding container 402b9d44dcbad4821ffc881830a425e7b8a9faf4b7d30102b97b51fc18446c32: Status 404 returned error can't find the container with id 402b9d44dcbad4821ffc881830a425e7b8a9faf4b7d30102b97b51fc18446c32
Jul 16 12:45:57.269448 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.269422    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mvrmc"]
Jul 16 12:45:57.291731 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.291706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mvrmc"]
Jul 16 12:45:57.291862 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.291793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.294979 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.294946    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 12:45:57.295155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.295027    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-745h9\""
Jul 16 12:45:57.295240 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.295203    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 12:45:57.295869 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.295853    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 12:45:57.297793 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.297774    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 12:45:57.324404 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.324376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:57.425005 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.424917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:57.447917 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.447887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74b5bf9e-29ad-489d-ac40-84f8d227283d-signing-key\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.448021 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.447924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74b5bf9e-29ad-489d-ac40-84f8d227283d-signing-cabundle\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.448021 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.447984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:57.448164 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.448032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967bl\" (UniqueName: \"kubernetes.io/projected/74b5bf9e-29ad-489d-ac40-84f8d227283d-kube-api-access-967bl\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.448164 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.448101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:57.448164 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:57.448149    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 12:45:57.448311 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.448176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:57.448311 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:57.448198    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:58.448183565 +0000 UTC m=+42.187173322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : secret "insights-runtime-extractor-tls" not found
Jul 16 12:45:57.448311 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:57.448206    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 12:45:57.448311 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:57.448249    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:58.44823341 +0000 UTC m=+42.187223189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : configmap "kube-rbac-proxy" not found
Jul 16 12:45:57.448311 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:57.448261    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 12:45:57.448311 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:57.448301    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls podName:7efedfaf-ec54-49bc-ba3c-08bb873abd11 nodeName:}" failed. No retries permitted until 2026-07-16 12:45:58.448288097 +0000 UTC m=+42.187277858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls") pod "dns-default-jt7hf" (UID: "7efedfaf-ec54-49bc-ba3c-08bb873abd11") : secret "dns-default-metrics-tls" not found
Jul 16 12:45:57.549076 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.549043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74b5bf9e-29ad-489d-ac40-84f8d227283d-signing-key\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.549076 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.549079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74b5bf9e-29ad-489d-ac40-84f8d227283d-signing-cabundle\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.549295 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.549278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967bl\" (UniqueName: \"kubernetes.io/projected/74b5bf9e-29ad-489d-ac40-84f8d227283d-kube-api-access-967bl\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.549769 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.549749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74b5bf9e-29ad-489d-ac40-84f8d227283d-signing-cabundle\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.552483 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.552465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74b5bf9e-29ad-489d-ac40-84f8d227283d-signing-key\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.558927 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.558909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967bl\" (UniqueName: \"kubernetes.io/projected/74b5bf9e-29ad-489d-ac40-84f8d227283d-kube-api-access-967bl\") pod \"service-ca-79f68b9f4f-mvrmc\" (UID: \"74b5bf9e-29ad-489d-ac40-84f8d227283d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.576462 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.576437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:57.600667 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.600642    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc"
Jul 16 12:45:57.639068 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.639043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:57.688310 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.688240    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7c9x4_8137dd54-1895-4825-8bd3-9f1a1c333487/node-ca/0.log"
Jul 16 12:45:57.749761 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:57.749729    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mvrmc"]
Jul 16 12:45:57.753789 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:45:57.753762    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b5bf9e_29ad_489d_ac40_84f8d227283d.slice/crio-aa65667ab3ed283c0ab18b1950866f49d4856c38d78eb4e248e2cea62a400c74 WatchSource:0}: Error finding container aa65667ab3ed283c0ab18b1950866f49d4856c38d78eb4e248e2cea62a400c74: Status 404 returned error can't find the container with id aa65667ab3ed283c0ab18b1950866f49d4856c38d78eb4e248e2cea62a400c74
Jul 16 12:45:58.020331 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.020219    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:58.065662 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.065620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc" event={"ID":"74b5bf9e-29ad-489d-ac40-84f8d227283d","Type":"ContainerStarted","Data":"aa65667ab3ed283c0ab18b1950866f49d4856c38d78eb4e248e2cea62a400c74"}
Jul 16 12:45:58.066881 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.066850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h882t" event={"ID":"a8539430-4cf2-4ec5-8f2e-f285fade1f8d","Type":"ContainerStarted","Data":"402b9d44dcbad4821ffc881830a425e7b8a9faf4b7d30102b97b51fc18446c32"}
Jul 16 12:45:58.139550 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.139507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:58.239461 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.239426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:45:58.457021 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.456940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:58.457021 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.457009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:45:58.457267 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.457051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:45:58.457267 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:58.457085    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 12:45:58.457267 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:58.457172    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 12:45:58.457267 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:58.457183    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 12:45:58.457267 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:58.457184    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:00.457162565 +0000 UTC m=+44.196152343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : configmap "kube-rbac-proxy" not found
Jul 16 12:45:58.457541 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:58.457289    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:00.457258574 +0000 UTC m=+44.196248345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : secret "insights-runtime-extractor-tls" not found
Jul 16 12:45:58.457541 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:45:58.457322    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls podName:7efedfaf-ec54-49bc-ba3c-08bb873abd11 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:00.457301202 +0000 UTC m=+44.196290965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls") pod "dns-default-jt7hf" (UID: "7efedfaf-ec54-49bc-ba3c-08bb873abd11") : secret "dns-default-metrics-tls" not found
Jul 16 12:45:58.490799 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:45:58.490757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:00.473307 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:00.473270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:00.473325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:00.473392    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:00.473408    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:00.473452    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:04.473438899 +0000 UTC m=+48.212428655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : configmap "kube-rbac-proxy" not found
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:00.473450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:00.473466    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls podName:7efedfaf-ec54-49bc-ba3c-08bb873abd11 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:04.473460389 +0000 UTC m=+48.212450145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls") pod "dns-default-jt7hf" (UID: "7efedfaf-ec54-49bc-ba3c-08bb873abd11") : secret "dns-default-metrics-tls" not found
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:00.473530    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 12:46:00.473672 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:00.473586    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:04.473571006 +0000 UTC m=+48.212560768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : secret "insights-runtime-extractor-tls" not found
Jul 16 12:46:01.076512 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:01.076249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h882t" event={"ID":"a8539430-4cf2-4ec5-8f2e-f285fade1f8d","Type":"ContainerStarted","Data":"dce2f9e2abf836aa489cb59256d77ad312d415d315125d7cb4b5cd13907efac8"}
Jul 16 12:46:01.077738 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:01.077719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc" event={"ID":"74b5bf9e-29ad-489d-ac40-84f8d227283d","Type":"ContainerStarted","Data":"8eb9a0e8aef8e9f696fff29070e2dc39f1cdaa1593cd97ddbbf8079c46da2b03"}
Jul 16 12:46:01.103212 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:01.103168    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h882t" podStartSLOduration=1.6358695189999999 podStartE2EDuration="5.103154759s" totalImagesPullingTime="3.46728524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:01.101523089 +0000 UTC m=+44.840512866" watchObservedRunningTime="2026-07-16 12:46:01.103154759 +0000 UTC m=+44.842144538"
Jul 16 12:46:01.125733 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:01.125685    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-mvrmc" podStartSLOduration=1.176333134 podStartE2EDuration="4.125671142s" totalImagesPullingTime="2.949338008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:01.125224128 +0000 UTC m=+44.864213943" watchObservedRunningTime="2026-07-16 12:46:01.125671142 +0000 UTC m=+44.864660918"
Jul 16 12:46:01.321593 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:01.321556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:01.427181 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:01.427150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:01.566921 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:01.566886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:02.565311 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:02.565279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:02.674705 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:02.674666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:02.779755 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:02.779724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:02.907496 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:02.907459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:03.008865 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:03.008836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:03.267983 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:03.267861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:03.694272 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:03.694241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:04.507442 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:04.507397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:04.507645 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:04.507459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:46:04.507645 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:04.507504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:04.507645 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:04.507534    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 12:46:04.507645 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:04.507556    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 12:46:04.507645 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:04.507614    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:12.50758885 +0000 UTC m=+56.246578606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : configmap "kube-rbac-proxy" not found
Jul 16 12:46:04.507645 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:04.507638    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls podName:7efedfaf-ec54-49bc-ba3c-08bb873abd11 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:12.507628155 +0000 UTC m=+56.246617913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls") pod "dns-default-jt7hf" (UID: "7efedfaf-ec54-49bc-ba3c-08bb873abd11") : secret "dns-default-metrics-tls" not found
Jul 16 12:46:04.507940 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:04.507656    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 12:46:04.507940 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:04.507701    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls podName:bdda2b5b-0eec-4991-864d-10550483dc57 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:12.507688831 +0000 UTC m=+56.246678591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68f8v" (UID: "bdda2b5b-0eec-4991-864d-10550483dc57") : secret "insights-runtime-extractor-tls" not found
Jul 16 12:46:04.629870 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:04.629818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:05.055421 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:05.055372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:05.277798 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:05.277767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:05.504223 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:05.504190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:05.680573 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:05.680536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:06.289617 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:06.289577    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:06.448614 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:06.448583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:06.692536 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:06.692507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:07.097375 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:07.097344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:07.306542 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:07.306495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:07.534521 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:07.534429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:07.685403 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:07.685372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:08.267637 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:08.267607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:08.834567 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:08.834532    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:08.941494 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:08.941460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:09.078973 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:09.078939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:09.271446 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:09.271410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:09.462593 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:09.462555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:09.657361 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:09.657324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:09.934722 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:09.934642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:10.642689 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:10.642657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:11.066403 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:11.066324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:11.371239 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:11.371203    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:11.490896 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:11.490861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:11.655594 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:11.655517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:12.565443 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.565406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:12.565917 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.565457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:46:12.565917 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.565483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:12.566070 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.566047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdda2b5b-0eec-4991-864d-10550483dc57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:12.568714 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.568691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7efedfaf-ec54-49bc-ba3c-08bb873abd11-metrics-tls\") pod \"dns-default-jt7hf\" (UID: \"7efedfaf-ec54-49bc-ba3c-08bb873abd11\") " pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:46:12.568796 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.568691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdda2b5b-0eec-4991-864d-10550483dc57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68f8v\" (UID: \"bdda2b5b-0eec-4991-864d-10550483dc57\") " pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:12.594190 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.594162    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:46:12.637497 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.637470    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-68f8v"
Jul 16 12:46:12.638601 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.638561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:12.825082 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.825009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jt7hf"]
Jul 16 12:46:12.828183 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:12.828153    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efedfaf_ec54_49bc_ba3c_08bb873abd11.slice/crio-f8713fa29089d8deea1c4d767937601ce0c7658d8f718517a2b9193df98c42f6 WatchSource:0}: Error finding container f8713fa29089d8deea1c4d767937601ce0c7658d8f718517a2b9193df98c42f6: Status 404 returned error can't find the container with id f8713fa29089d8deea1c4d767937601ce0c7658d8f718517a2b9193df98c42f6
Jul 16 12:46:12.843064 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.843042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-68f8v"]
Jul 16 12:46:12.846281 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:12.846261    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdda2b5b_0eec_4991_864d_10550483dc57.slice/crio-26fb1963674dead07ef83d85dc0f9baf04750a2f958a2ab7df93c7f2ca27d709 WatchSource:0}: Error finding container 26fb1963674dead07ef83d85dc0f9baf04750a2f958a2ab7df93c7f2ca27d709: Status 404 returned error can't find the container with id 26fb1963674dead07ef83d85dc0f9baf04750a2f958a2ab7df93c7f2ca27d709
Jul 16 12:46:12.848159 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:12.848132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:13.041489 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:13.041461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:13.105958 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:13.105927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68f8v" event={"ID":"bdda2b5b-0eec-4991-864d-10550483dc57","Type":"ContainerStarted","Data":"26fb1963674dead07ef83d85dc0f9baf04750a2f958a2ab7df93c7f2ca27d709"}
Jul 16 12:46:13.107018 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:13.106992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jt7hf" event={"ID":"7efedfaf-ec54-49bc-ba3c-08bb873abd11","Type":"ContainerStarted","Data":"f8713fa29089d8deea1c4d767937601ce0c7658d8f718517a2b9193df98c42f6"}
Jul 16 12:46:13.287661 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:13.287628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:16.117233 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:16.117198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jt7hf" event={"ID":"7efedfaf-ec54-49bc-ba3c-08bb873abd11","Type":"ContainerStarted","Data":"ee11d91ee6d3e182e70e2e25a51858dbaecd7c477d8fcf11a819f87eb21cd786"}
Jul 16 12:46:16.117755 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:16.117257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jt7hf" event={"ID":"7efedfaf-ec54-49bc-ba3c-08bb873abd11","Type":"ContainerStarted","Data":"b342f74f85a708dfc6f83c867f48a2c7fc0dcd2e5ac97d8fea625fad3a9f845d"}
Jul 16 12:46:16.117755 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:16.117325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:46:16.138188 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:16.138130    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jt7hf" podStartSLOduration=17.880413734 podStartE2EDuration="20.138098538s" totalImagesPullingTime="2.257684804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:16.1379604 +0000 UTC m=+59.876950201" watchObservedRunningTime="2026-07-16 12:46:16.138098538 +0000 UTC m=+59.877088294"
Jul 16 12:46:17.359261 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.359224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:17.552249 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.552188    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"]
Jul 16 12:46:17.556787 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.556759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.564531 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.564509    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5ghsv\""
Jul 16 12:46:17.565053 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.565032    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 12:46:17.565181 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.565032    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 12:46:17.565886 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.565870    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 12:46:17.566218 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.566193    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 12:46:17.570394 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.570369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:17.581163 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.579999    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"]
Jul 16 12:46:17.582536 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.582503    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"]
Jul 16 12:46:17.582663 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.582604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.598125 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.598091    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 12:46:17.598248 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.598169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 12:46:17.598467 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.598444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 12:46:17.598808 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.598787    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 12:46:17.603738 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.603717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-hub\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.603850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.603749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.603850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.603777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.603850 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.603829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-ca\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.604018 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.603855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkbsf\" (UniqueName: \"kubernetes.io/projected/3a8d02ae-443f-4a45-a5ec-a17157645d9a-kube-api-access-jkbsf\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.604018 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.603964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e16017ea-39e9-478d-92cc-39c8a821fdec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cfddb644-7pd6b\" (UID: \"e16017ea-39e9-478d-92cc-39c8a821fdec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.604018 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.603994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8d02ae-443f-4a45-a5ec-a17157645d9a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.604348 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.604046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6tkx\" (UniqueName: \"kubernetes.io/projected/e16017ea-39e9-478d-92cc-39c8a821fdec-kube-api-access-k6tkx\") pod \"managed-serviceaccount-addon-agent-5cfddb644-7pd6b\" (UID: \"e16017ea-39e9-478d-92cc-39c8a821fdec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.631071 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.630995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"]
Jul 16 12:46:17.705166 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.705383 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-ca\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.705383 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkbsf\" (UniqueName: \"kubernetes.io/projected/3a8d02ae-443f-4a45-a5ec-a17157645d9a-kube-api-access-jkbsf\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.705517 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e16017ea-39e9-478d-92cc-39c8a821fdec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cfddb644-7pd6b\" (UID: \"e16017ea-39e9-478d-92cc-39c8a821fdec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.705604 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8d02ae-443f-4a45-a5ec-a17157645d9a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.705745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6tkx\" (UniqueName: \"kubernetes.io/projected/e16017ea-39e9-478d-92cc-39c8a821fdec-kube-api-access-k6tkx\") pod \"managed-serviceaccount-addon-agent-5cfddb644-7pd6b\" (UID: \"e16017ea-39e9-478d-92cc-39c8a821fdec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.705745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-hub\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.705745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.705722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.706428 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.706372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8d02ae-443f-4a45-a5ec-a17157645d9a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.708290 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.708265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-ca\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.708410 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.708272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.708474 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.708424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e16017ea-39e9-478d-92cc-39c8a821fdec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cfddb644-7pd6b\" (UID: \"e16017ea-39e9-478d-92cc-39c8a821fdec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.708759 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.708728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.709481 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.709455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3a8d02ae-443f-4a45-a5ec-a17157645d9a-hub\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.750930 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.750901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkbsf\" (UniqueName: \"kubernetes.io/projected/3a8d02ae-443f-4a45-a5ec-a17157645d9a-kube-api-access-jkbsf\") pod \"cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x\" (UID: \"3a8d02ae-443f-4a45-a5ec-a17157645d9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.753169 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.753102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6tkx\" (UniqueName: \"kubernetes.io/projected/e16017ea-39e9-478d-92cc-39c8a821fdec-kube-api-access-k6tkx\") pod \"managed-serviceaccount-addon-agent-5cfddb644-7pd6b\" (UID: \"e16017ea-39e9-478d-92cc-39c8a821fdec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.778810 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.778775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:17.874594 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.874561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"
Jul 16 12:46:17.894320 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.894255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"
Jul 16 12:46:17.984509 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:17.984455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:18.047224 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.047176    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbls2"
Jul 16 12:46:18.107319 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.107085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:18.126259 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.126232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68f8v" event={"ID":"bdda2b5b-0eec-4991-864d-10550483dc57","Type":"ContainerStarted","Data":"4ba6c428145ec37f7f6d54e22dd4bed1d4f77ff5d914cd47df156b2cea9f0be8"}
Jul 16 12:46:18.146800 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.146732    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x"]
Jul 16 12:46:18.152612 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:18.152528    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a8d02ae_443f_4a45_a5ec_a17157645d9a.slice/crio-d6e5e5f97e608b6c18a1d178649f545d20f9f346540120f2a7141c0d63371dcb WatchSource:0}: Error finding container d6e5e5f97e608b6c18a1d178649f545d20f9f346540120f2a7141c0d63371dcb: Status 404 returned error can't find the container with id d6e5e5f97e608b6c18a1d178649f545d20f9f346540120f2a7141c0d63371dcb
Jul 16 12:46:18.163540 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.163517    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b"]
Jul 16 12:46:18.166314 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:18.166289    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode16017ea_39e9_478d_92cc_39c8a821fdec.slice/crio-e3820c8ccee3f1cabfce52a8ab9cbebead6b20c048f6f749b85fe54f1c0878ff WatchSource:0}: Error finding container e3820c8ccee3f1cabfce52a8ab9cbebead6b20c048f6f749b85fe54f1c0878ff: Status 404 returned error can't find the container with id e3820c8ccee3f1cabfce52a8ab9cbebead6b20c048f6f749b85fe54f1c0878ff
Jul 16 12:46:18.208329 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.208296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:18.501627 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.501530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:18.604262 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.604214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:18.717884 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.717838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:18.931186 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:18.931019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:19.017599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:19.017521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:19.135999 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:19.135951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x" event={"ID":"3a8d02ae-443f-4a45-a5ec-a17157645d9a","Type":"ContainerStarted","Data":"d6e5e5f97e608b6c18a1d178649f545d20f9f346540120f2a7141c0d63371dcb"}
Jul 16 12:46:19.138952 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:19.138917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b" event={"ID":"e16017ea-39e9-478d-92cc-39c8a821fdec","Type":"ContainerStarted","Data":"e3820c8ccee3f1cabfce52a8ab9cbebead6b20c048f6f749b85fe54f1c0878ff"}
Jul 16 12:46:19.148313 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:19.148284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:19.313009 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:19.310136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:20.199450 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:20.199415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:21.541000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.540961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:46:21.541000 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.541015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:46:21.544222 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.544199    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 12:46:21.544727 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.544713    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 12:46:21.554147 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.554101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37e50b87-c3e2-45fb-8c7e-7fd07471b20e-original-pull-secret\") pod \"global-pull-secret-syncer-qc2j4\" (UID: \"37e50b87-c3e2-45fb-8c7e-7fd07471b20e\") " pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:46:21.554320 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.554297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d58961ef-c4ac-48f5-bc94-3df3ba51073e-metrics-certs\") pod \"network-metrics-daemon-pzs8z\" (UID: \"d58961ef-c4ac-48f5-bc94-3df3ba51073e\") " pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:46:21.642431 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.642396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:46:21.645446 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.645422    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 12:46:21.656240 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.656216    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 12:46:21.667160 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.667140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpz55\" (UniqueName: \"kubernetes.io/projected/66ad8bdf-3b70-4533-93cb-84d3e9e708d3-kube-api-access-dpz55\") pod \"network-check-target-4ww9t\" (UID: \"66ad8bdf-3b70-4533-93cb-84d3e9e708d3\") " pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:46:21.743575 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.743542    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xrlr5\""
Jul 16 12:46:21.748784 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.748753    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sbdj2\""
Jul 16 12:46:21.751858 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.751832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzs8z"
Jul 16 12:46:21.752019 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.751856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qc2j4"
Jul 16 12:46:21.757067 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:21.757046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:46:22.493215 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:22.493173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:22.897016 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:22.896982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:22.987652 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:22.987613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:24.499950 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:24.499895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:24.603308 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:24.603253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:24.612892 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:24.612333    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ww9t"]
Jul 16 12:46:24.615658 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:24.615479    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ad8bdf_3b70_4533_93cb_84d3e9e708d3.slice/crio-1cf84c7b4d6a158f08305c75980dca79424a39e899ce26742358833b5f761727 WatchSource:0}: Error finding container 1cf84c7b4d6a158f08305c75980dca79424a39e899ce26742358833b5f761727: Status 404 returned error can't find the container with id 1cf84c7b4d6a158f08305c75980dca79424a39e899ce26742358833b5f761727
Jul 16 12:46:24.841870 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:24.841845    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pzs8z"]
Jul 16 12:46:24.844061 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:24.844034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qc2j4"]
Jul 16 12:46:24.844199 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:24.844075    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58961ef_c4ac_48f5_bc94_3df3ba51073e.slice/crio-5a0e3c4d73670dc3003acd1d4207df5e1a18a7309ebea9fc9ccd9c97271bc46c WatchSource:0}: Error finding container 5a0e3c4d73670dc3003acd1d4207df5e1a18a7309ebea9fc9ccd9c97271bc46c: Status 404 returned error can't find the container with id 5a0e3c4d73670dc3003acd1d4207df5e1a18a7309ebea9fc9ccd9c97271bc46c
Jul 16 12:46:24.847140 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:24.847117    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e50b87_c3e2_45fb_8c7e_7fd07471b20e.slice/crio-70f0c3246d4def0143f9977c3913d45b01acba8bf6397a2aab21c96ed77c6603 WatchSource:0}: Error finding container 70f0c3246d4def0143f9977c3913d45b01acba8bf6397a2aab21c96ed77c6603: Status 404 returned error can't find the container with id 70f0c3246d4def0143f9977c3913d45b01acba8bf6397a2aab21c96ed77c6603
Jul 16 12:46:25.165722 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.165686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68f8v" event={"ID":"bdda2b5b-0eec-4991-864d-10550483dc57","Type":"ContainerStarted","Data":"49703c5fadb7f976b04607924a960a8f0d0a998d46da9299d2300a74ffef1dc8"}
Jul 16 12:46:25.167022 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.166993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ww9t" event={"ID":"66ad8bdf-3b70-4533-93cb-84d3e9e708d3","Type":"ContainerStarted","Data":"1cf84c7b4d6a158f08305c75980dca79424a39e899ce26742358833b5f761727"}
Jul 16 12:46:25.168312 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.168286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qc2j4" event={"ID":"37e50b87-c3e2-45fb-8c7e-7fd07471b20e","Type":"ContainerStarted","Data":"70f0c3246d4def0143f9977c3913d45b01acba8bf6397a2aab21c96ed77c6603"}
Jul 16 12:46:25.170451 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.170428    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x" event={"ID":"3a8d02ae-443f-4a45-a5ec-a17157645d9a","Type":"ContainerStarted","Data":"187c8d071159b505ffec72dbe39960e6724c04a1ae32b78fe75208c271496652"}
Jul 16 12:46:25.170550 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.170465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x" event={"ID":"3a8d02ae-443f-4a45-a5ec-a17157645d9a","Type":"ContainerStarted","Data":"c2f60f01ac25e22db5a92d1752279a012562cfb17a793a859cccca156413a585"}
Jul 16 12:46:25.170550 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.170484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x" event={"ID":"3a8d02ae-443f-4a45-a5ec-a17157645d9a","Type":"ContainerStarted","Data":"88fdd63944f25bcba048bb7bb1abc28ecf396277219ac4545f4bc420b9e4cf46"}
Jul 16 12:46:25.171672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.171647    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzs8z" event={"ID":"d58961ef-c4ac-48f5-bc94-3df3ba51073e","Type":"ContainerStarted","Data":"5a0e3c4d73670dc3003acd1d4207df5e1a18a7309ebea9fc9ccd9c97271bc46c"}
Jul 16 12:46:25.173164 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.173139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b" event={"ID":"e16017ea-39e9-478d-92cc-39c8a821fdec","Type":"ContainerStarted","Data":"4fcc5bd1e427da24ef4569a046dd260ad36776d03e3ad14b05bcf69c1726c37c"}
Jul 16 12:46:25.238875 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.238818    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6d5fc8c8-r8x5x" podStartSLOduration=1.910900504 podStartE2EDuration="8.23879965s" totalImagesPullingTime="6.327899146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:25.212518567 +0000 UTC m=+68.951508367" watchObservedRunningTime="2026-07-16 12:46:25.23879965 +0000 UTC m=+68.977789429"
Jul 16 12:46:25.239199 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.239095    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cfddb644-7pd6b" podStartSLOduration=1.971327373 podStartE2EDuration="8.23908629s" totalImagesPullingTime="6.267758917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:25.23877599 +0000 UTC m=+68.977765761" watchObservedRunningTime="2026-07-16 12:46:25.23908629 +0000 UTC m=+68.978076069"
Jul 16 12:46:25.262607 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.262569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:25.365497 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.365455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:25.456885 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.456804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:25.892935 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:25.892887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:26.123369 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:26.123339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jt7hf"
Jul 16 12:46:29.483420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:29.483363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:29.583986 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:29.583935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:30.196720 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.196680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68f8v" event={"ID":"bdda2b5b-0eec-4991-864d-10550483dc57","Type":"ContainerStarted","Data":"86b0b1de8cd346ddf54a19de3f2c0a587fee7e7f288822c0b58b3ee228049a89"}
Jul 16 12:46:30.198545 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.198507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ww9t" event={"ID":"66ad8bdf-3b70-4533-93cb-84d3e9e708d3","Type":"ContainerStarted","Data":"3519784b2a9ac6fa627dbf1e3388835d6d61327ac01d2bce1daeff86aedd28b3"}
Jul 16 12:46:30.198709 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.198654    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:46:30.200455 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.200364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzs8z" event={"ID":"d58961ef-c4ac-48f5-bc94-3df3ba51073e","Type":"ContainerStarted","Data":"f47d29ddebaf62cbcae6176246a01b8f829fe2c93fab5d6e4c7608986123c60a"}
Jul 16 12:46:30.200455 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.200415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzs8z" event={"ID":"d58961ef-c4ac-48f5-bc94-3df3ba51073e","Type":"ContainerStarted","Data":"e8d4babf9f188a600089dba7c9510489af60bbe56174ad4841b6fc5983377fdb"}
Jul 16 12:46:30.219538 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.219482    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-68f8v" podStartSLOduration=17.476780431 podStartE2EDuration="34.219466792s" totalImagesPullingTime="16.742686361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:30.217760859 +0000 UTC m=+73.956750655" watchObservedRunningTime="2026-07-16 12:46:30.219466792 +0000 UTC m=+73.958456570"
Jul 16 12:46:30.242686 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.242630    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pzs8z" podStartSLOduration=68.320631229 podStartE2EDuration="1m13.242615303s" totalImagesPullingTime="4.921984074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:30.241264622 +0000 UTC m=+73.980254502" watchObservedRunningTime="2026-07-16 12:46:30.242615303 +0000 UTC m=+73.981605082"
Jul 16 12:46:30.264634 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.264578    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4ww9t" podStartSLOduration=68.103501425 podStartE2EDuration="1m13.264555483s" totalImagesPullingTime="5.161054058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:30.263391439 +0000 UTC m=+74.002381221" watchObservedRunningTime="2026-07-16 12:46:30.264555483 +0000 UTC m=+74.003545263"
Jul 16 12:46:30.673097 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.673055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:30.746039 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:30.745989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:31.460264 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:31.460199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:31.540765 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:31.540725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:32.212733 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:32.212648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qc2j4" event={"ID":"37e50b87-c3e2-45fb-8c7e-7fd07471b20e","Type":"ContainerStarted","Data":"4ceb0504028c0415589626d1aa3ec6bcac0cf0cf39393e7cd3968d5b611ec332"}
Jul 16 12:46:32.235068 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:32.235016    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qc2j4" podStartSLOduration=68.149228467 podStartE2EDuration="1m15.235001794s" totalImagesPullingTime="7.085773327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:32.233916509 +0000 UTC m=+75.972906300" watchObservedRunningTime="2026-07-16 12:46:32.235001794 +0000 UTC m=+75.973991572"
Jul 16 12:46:35.335457 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:35.335424    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:37.124992 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:37.124955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:37.225103 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:37.225063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:40.165724 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:40.165596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:40.266173 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:40.266127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:40.519514 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:40.519422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:40.607486 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:40.607457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:40.672381 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:40.672344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:42.346127 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:42.346085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:42.444324 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:42.444286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:46.800572 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:46.800515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:47.718785 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:47.718731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:48.077416 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.077321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:48.155429 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.155399    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ckng5"]
Jul 16 12:46:48.161295 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.161272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.164366 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.164328    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2nc5p\""
Jul 16 12:46:48.164876 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.164712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 12:46:48.164876 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.164750    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 12:46:48.165348 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.165134    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 12:46:48.165348 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.165149    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 12:46:48.165348 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.165221    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 12:46:48.167534 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.167351    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 12:46:48.188750 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.188727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:48.226683 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-sys\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.226820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed107659-4317-4061-89c0-08eec3dbce21-metrics-client-ca\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.226820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.226820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.226820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-root\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.226976 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-textfile\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.226976 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-tls\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.227062 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.226988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-wtmp\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.227062 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.227012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sql8c\" (UniqueName: \"kubernetes.io/projected/ed107659-4317-4061-89c0-08eec3dbce21-kube-api-access-sql8c\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.306697 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.306660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:48.327552 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-wtmp\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.327552 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql8c\" (UniqueName: \"kubernetes.io/projected/ed107659-4317-4061-89c0-08eec3dbce21-kube-api-access-sql8c\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.327745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-sys\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.327745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed107659-4317-4061-89c0-08eec3dbce21-metrics-client-ca\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.327745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.327745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-wtmp\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.327745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.327745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-root\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.328035 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-textfile\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.328035 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.327798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-tls\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.328035 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:48.327913    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 12:46:48.328035 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:48.327968    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-tls podName:ed107659-4317-4061-89c0-08eec3dbce21 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:48.827950728 +0000 UTC m=+92.566940485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-tls") pod "node-exporter-ckng5" (UID: "ed107659-4317-4061-89c0-08eec3dbce21") : secret "node-exporter-tls" not found
Jul 16 12:46:48.328035 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.328008    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-root\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.328333 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.328296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-textfile\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.328333 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.328317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.328436 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.328381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed107659-4317-4061-89c0-08eec3dbce21-sys\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.328758 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.328736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed107659-4317-4061-89c0-08eec3dbce21-metrics-client-ca\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.330561 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.330537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.338037 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.338017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sql8c\" (UniqueName: \"kubernetes.io/projected/ed107659-4317-4061-89c0-08eec3dbce21-kube-api-access-sql8c\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.577835 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.577749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:48.678696 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.678663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:48.799522 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.799494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:48.831285 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.831217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-tls\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.833513 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.833492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed107659-4317-4061-89c0-08eec3dbce21-node-exporter-tls\") pod \"node-exporter-ckng5\" (UID: \"ed107659-4317-4061-89c0-08eec3dbce21\") " pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:48.900459 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:48.900411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:49.000365 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.000323    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:49.074079 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.074051    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckng5"
Jul 16 12:46:49.084927 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:49.084897    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded107659_4317_4061_89c0_08eec3dbce21.slice/crio-2a83e9760aa4d4d84b515224043e33fd1fcd6b004d8e6699f2b431be7626a90e WatchSource:0}: Error finding container 2a83e9760aa4d4d84b515224043e33fd1fcd6b004d8e6699f2b431be7626a90e: Status 404 returned error can't find the container with id 2a83e9760aa4d4d84b515224043e33fd1fcd6b004d8e6699f2b431be7626a90e
Jul 16 12:46:49.089264 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.089234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:49.093602 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.093575    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:46:49.097738 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.097723    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.100005 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.099985    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 12:46:49.100102 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.100004    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 12:46:49.100261 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.100248    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 12:46:49.100469 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.100446    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 12:46:49.100620 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.100600    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 12:46:49.100847 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.100832    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 12:46:49.100971 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.100954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 12:46:49.101060 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.101045    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c8qvd\""
Jul 16 12:46:49.101132 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.101062    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 12:46:49.101299 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.101286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 12:46:49.116087 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.116066    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:46:49.209832 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.209795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:49.234573 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-out\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234573 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-web-config\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234798 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234798 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234798 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234798 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234798 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234993 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234993 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscfc\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-kube-api-access-pscfc\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234993 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234993 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234993 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.234993 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.234984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.266162 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.266128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckng5" event={"ID":"ed107659-4317-4061-89c0-08eec3dbce21","Type":"ContainerStarted","Data":"2a83e9760aa4d4d84b515224043e33fd1fcd6b004d8e6699f2b431be7626a90e"}
Jul 16 12:46:49.315065 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.315031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:49.335879 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.335854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336028 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.335888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336028 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.335920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336028 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.335955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336028 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.335986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscfc\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-kube-api-access-pscfc\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336028 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:46:49.336043    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle podName:a1d23adf-ab3b-415e-87d5-5c25acffd2b3 nodeName:}" failed. No retries permitted until 2026-07-16 12:46:49.836020571 +0000 UTC m=+93.575010348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3") : configmap references non-existent config key: ca-bundle.crt
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-out\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-web-config\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336298 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.336947 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.336920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.337244 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.337217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.339036 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.339010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.339160 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.339037    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.339226 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.339161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.339537 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.339516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.339601 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.339533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.339601 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.339519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.339727 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.339710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-out\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.340367 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.340347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.341202 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.341183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-web-config\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.345498 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.345478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscfc\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-kube-api-access-pscfc\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.840458 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.840432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:49.841188 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:49.841169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:50.008265 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.008232    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:46:50.009402 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.009360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:50.107668 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.107584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:50.151931 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.151823    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:46:50.153940 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:50.153909    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d23adf_ab3b_415e_87d5_5c25acffd2b3.slice/crio-af1b19644817a14ad1f49de82550ac5b11e84f99023cc900f4151c20c38a714d WatchSource:0}: Error finding container af1b19644817a14ad1f49de82550ac5b11e84f99023cc900f4151c20c38a714d: Status 404 returned error can't find the container with id af1b19644817a14ad1f49de82550ac5b11e84f99023cc900f4151c20c38a714d
Jul 16 12:46:50.270457 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.270419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerStarted","Data":"af1b19644817a14ad1f49de82550ac5b11e84f99023cc900f4151c20c38a714d"}
Jul 16 12:46:50.272015 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.271980    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed107659-4317-4061-89c0-08eec3dbce21" containerID="94f90132133c285bc8b823f4474f60b701cf91f99abf4a3efd4af3421d2bc291" exitCode=0
Jul 16 12:46:50.272198 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.272049    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckng5" event={"ID":"ed107659-4317-4061-89c0-08eec3dbce21","Type":"ContainerDied","Data":"94f90132133c285bc8b823f4474f60b701cf91f99abf4a3efd4af3421d2bc291"}
Jul 16 12:46:50.949209 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:50.949170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.011281 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.011252    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-76f7677775-8vhfx"]
Jul 16 12:46:51.026679 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.026652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.029484 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.029449    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 16 12:46:51.029484 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.029463    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3s66th4stssm8\""
Jul 16 12:46:51.029484 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.029469    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ws5gg\""
Jul 16 12:46:51.029484 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.029468    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 16 12:46:51.029770 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.029451    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 16 12:46:51.029770 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.029456    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 16 12:46:51.029770 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.029747    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 16 12:46:51.032374 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.032351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76f7677775-8vhfx"]
Jul 16 12:46:51.042821 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.042795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.128838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.128794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.152842 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.152817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7592045e-7895-45c1-bad3-7cb42ecc3ff6-metrics-client-ca\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.152960 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.152851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.152960 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.152871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-grpc-tls\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.152960 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.152896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.152960 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.152944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.153141 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.152999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-tls\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.153141 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.153046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.153141 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.153075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2w6p\" (UniqueName: \"kubernetes.io/projected/7592045e-7895-45c1-bad3-7cb42ecc3ff6-kube-api-access-n2w6p\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254057 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.253974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254057 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.254016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254057 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.254037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-tls\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254057 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.254056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254400 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.254074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2w6p\" (UniqueName: \"kubernetes.io/projected/7592045e-7895-45c1-bad3-7cb42ecc3ff6-kube-api-access-n2w6p\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254400 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.254150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7592045e-7895-45c1-bad3-7cb42ecc3ff6-metrics-client-ca\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254400 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.254186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.254400 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.254210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-grpc-tls\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.255209 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.255179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7592045e-7895-45c1-bad3-7cb42ecc3ff6-metrics-client-ca\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.256946 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.256924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.257042 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.256943    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-tls\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.257127 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.257085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.257196 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.257158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.257301 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.257277    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-grpc-tls\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.257386 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.257318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7592045e-7895-45c1-bad3-7cb42ecc3ff6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.264140 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.264100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2w6p\" (UniqueName: \"kubernetes.io/projected/7592045e-7895-45c1-bad3-7cb42ecc3ff6-kube-api-access-n2w6p\") pod \"thanos-querier-76f7677775-8vhfx\" (UID: \"7592045e-7895-45c1-bad3-7cb42ecc3ff6\") " pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.281283 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.281252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckng5" event={"ID":"ed107659-4317-4061-89c0-08eec3dbce21","Type":"ContainerStarted","Data":"bf2f4d76b1a21f6a1894fd2ef192d72ab42474e49eea9cfc157bae4884b61501"}
Jul 16 12:46:51.281403 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.281326    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckng5" event={"ID":"ed107659-4317-4061-89c0-08eec3dbce21","Type":"ContainerStarted","Data":"ca7ed5ba509575d245716fdc85112fffe92b50f9deecb88c5240d6d0a113818b"}
Jul 16 12:46:51.282633 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.282609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.309120 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.309062    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ckng5" podStartSLOduration=2.451292633 podStartE2EDuration="3.309049167s" totalImagesPullingTime="793.540926ms" totalInitContainerRuntime="64.215608ms" isStatefulPod=true podCreationTimestamp="2026-07-16 12:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:51.308078472 +0000 UTC m=+95.047068288" watchObservedRunningTime="2026-07-16 12:46:51.309049167 +0000 UTC m=+95.048038982"
Jul 16 12:46:51.338831 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.338801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:51.542697 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:51.542608    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76f7677775-8vhfx"]
Jul 16 12:46:51.546825 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:46:51.546799    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7592045e_7895_45c1_bad3_7cb42ecc3ff6.slice/crio-6b7833fc12889d742f3c8cb745e24ccba550292f4764f60a5ada5a108c39cd02 WatchSource:0}: Error finding container 6b7833fc12889d742f3c8cb745e24ccba550292f4764f60a5ada5a108c39cd02: Status 404 returned error can't find the container with id 6b7833fc12889d742f3c8cb745e24ccba550292f4764f60a5ada5a108c39cd02
Jul 16 12:46:52.287370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:52.287334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" event={"ID":"7592045e-7895-45c1-bad3-7cb42ecc3ff6","Type":"ContainerStarted","Data":"6b7833fc12889d742f3c8cb745e24ccba550292f4764f60a5ada5a108c39cd02"}
Jul 16 12:46:52.706910 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:52.706875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:52.816888 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:52.816853    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:52.919948 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:52.919852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:53.183553 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:53.183456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:53.265721 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:53.265685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:53.292608 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:53.292574    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerID="15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096" exitCode=0
Jul 16 12:46:53.293072 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:53.292669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096"}
Jul 16 12:46:54.263637 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:54.263554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:54.299308 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:54.299265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" event={"ID":"7592045e-7895-45c1-bad3-7cb42ecc3ff6","Type":"ContainerStarted","Data":"8a4ac8bd7264bc218ca05d1e0c3a753c4282d51e9b944e1b1e89affb4211752d"}
Jul 16 12:46:54.299746 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:54.299350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" event={"ID":"7592045e-7895-45c1-bad3-7cb42ecc3ff6","Type":"ContainerStarted","Data":"3d549c7ffde91f5a10c479197ef69c3a2a49f6dbea00188f71933b59a746fd5f"}
Jul 16 12:46:54.299746 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:54.299394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" event={"ID":"7592045e-7895-45c1-bad3-7cb42ecc3ff6","Type":"ContainerStarted","Data":"75e662cca3cfd02513f70da594cb30989fcfe371f250bdded44faf453b997196"}
Jul 16 12:46:54.649808 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:54.649768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:54.732634 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:54.732593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:56.159360 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.159311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:56.311745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.311707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" event={"ID":"7592045e-7895-45c1-bad3-7cb42ecc3ff6","Type":"ContainerStarted","Data":"47e217617a48f70f6113ab0b66623b9d5ed0a1fc6ebed3006c3a7b182d3c9746"}
Jul 16 12:46:56.311933 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.311822    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:46:56.311933 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.311863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" event={"ID":"7592045e-7895-45c1-bad3-7cb42ecc3ff6","Type":"ContainerStarted","Data":"0c95416d2132ff8502a503cbd6442e93a42bffa7f1b900027d5205e8e5fccaba"}
Jul 16 12:46:56.311933 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.311902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" event={"ID":"7592045e-7895-45c1-bad3-7cb42ecc3ff6","Type":"ContainerStarted","Data":"210a57a6bf527bde159883d663cb49ba95984bd41bd1d1be7d64bcec88f31846"}
Jul 16 12:46:56.314816 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.314790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerStarted","Data":"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"}
Jul 16 12:46:56.314922 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.314859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerStarted","Data":"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"}
Jul 16 12:46:56.314922 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.314898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerStarted","Data":"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"}
Jul 16 12:46:56.314990 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.314935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerStarted","Data":"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"}
Jul 16 12:46:56.314990 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.314978    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerStarted","Data":"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"}
Jul 16 12:46:56.315050 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.315006    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerStarted","Data":"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"}
Jul 16 12:46:56.348083 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.348021    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx" podStartSLOduration=2.343527622 podStartE2EDuration="6.348001931s" totalImagesPullingTime="4.004474309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:46:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:56.346433622 +0000 UTC m=+100.085423420" watchObservedRunningTime="2026-07-16 12:46:56.348001931 +0000 UTC m=+100.086991710"
Jul 16 12:46:56.406725 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:46:56.406678    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.975153167 podStartE2EDuration="7.406660819s" totalImagesPullingTime="4.409746067s" totalInitContainerRuntime="21.761585ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:46:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:56.405611754 +0000 UTC m=+100.144601536" watchObservedRunningTime="2026-07-16 12:46:56.406660819 +0000 UTC m=+100.145650607"
Jul 16 12:47:01.206505 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:01.206475    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4ww9t"
Jul 16 12:47:02.327438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:02.327413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-76f7677775-8vhfx"
Jul 16 12:47:02.587497 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:02.587463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:02.692744 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:02.692712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:02.799686 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:02.799655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:04.336410 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:04.336370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:04.429766 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:04.429733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:05.305617 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:05.305582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:05.408577 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:05.408536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:07.850593 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:07.850559    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:07.922271 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:07.922239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:09.752006 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:09.751963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:09.851534 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:09.851495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:09.933817 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:09.933788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:22.930355 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:22.930318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:23.116070 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:47:23.116037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:04.176780 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:04.176746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:04.278179 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:04.278143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:08.520050 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:08.519959    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:48:08.573935 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:08.573898    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="alertmanager" containerID="cri-o://8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd" gracePeriod=120
Jul 16 12:48:08.574158 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:08.573946    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-metric" containerID="cri-o://e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8" gracePeriod=120
Jul 16 12:48:08.574158 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:08.573996    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="config-reloader" containerID="cri-o://fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e" gracePeriod=120
Jul 16 12:48:08.574158 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:08.574026    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy" containerID="cri-o://aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa" gracePeriod=120
Jul 16 12:48:08.574158 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:08.573984    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-web" containerID="cri-o://e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff" gracePeriod=120
Jul 16 12:48:08.574158 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:08.574098    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="prom-label-proxy" containerID="cri-o://1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d" gracePeriod=120
Jul 16 12:48:09.579897 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.579866    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerID="1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d" exitCode=0
Jul 16 12:48:09.579897 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.579891    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerID="aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa" exitCode=0
Jul 16 12:48:09.579897 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.579899    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerID="fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e" exitCode=0
Jul 16 12:48:09.580345 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.579908    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerID="8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd" exitCode=0
Jul 16 12:48:09.580345 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.579931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"}
Jul 16 12:48:09.580345 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.580003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"}
Jul 16 12:48:09.580345 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.580040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"}
Jul 16 12:48:09.580345 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.580066    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"}
Jul 16 12:48:09.808890 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.808864    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:09.945980 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.945944    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pscfc\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-kube-api-access-pscfc\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.945980 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.945984    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-cluster-tls-config\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946267 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946011    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-web-config\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946267 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946029    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946267 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946203    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946267 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-main-tls\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946478 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946294    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946478 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946330    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-metrics-client-ca\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946478 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946365    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-out\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946478 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946393    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-tls-assets\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946478 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-main-db\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946478 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946776 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946497    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-volume\") pod \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\" (UID: \"a1d23adf-ab3b-415e-87d5-5c25acffd2b3\") "
Jul 16 12:48:09.946776 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.946742    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:48:09.948940 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.948772    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-kube-api-access-pscfc" (OuterVolumeSpecName: "kube-api-access-pscfc") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "kube-api-access-pscfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:48:09.948940 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.948769    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:48:09.948940 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.948833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:48:09.948940 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.948918    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-volume" (OuterVolumeSpecName: "config-volume") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:48:09.949315 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.949007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:48:09.949315 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.949146    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:48:09.949315 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.949147    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:48:09.949438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.949356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:48:09.951285 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.951255    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-out" (OuterVolumeSpecName: "config-out") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:48:09.951374 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.951323    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:48:09.953958 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.953934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:48:09.959654 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:09.959633    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-web-config" (OuterVolumeSpecName: "web-config") pod "a1d23adf-ab3b-415e-87d5-5c25acffd2b3" (UID: "a1d23adf-ab3b-415e-87d5-5c25acffd2b3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:48:10.047341 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047310    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047341 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047339    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-main-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047341 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047349    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047358    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-metrics-client-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047367    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-out\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047376    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-tls-assets\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047389    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-alertmanager-main-db\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047402    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047414    2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-config-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047423    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pscfc\" (UniqueName: \"kubernetes.io/projected/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-kube-api-access-pscfc\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047431    2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-cluster-tls-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047439    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-web-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.047544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.047447    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1d23adf-ab3b-415e-87d5-5c25acffd2b3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:48:10.586881 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.586852    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerID="e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8" exitCode=0
Jul 16 12:48:10.586881 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.586875    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerID="e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff" exitCode=0
Jul 16 12:48:10.587313 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.586910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"}
Jul 16 12:48:10.587313 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.586925    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.587313 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.586986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"}
Jul 16 12:48:10.587313 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.587016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a1d23adf-ab3b-415e-87d5-5c25acffd2b3","Type":"ContainerDied","Data":"af1b19644817a14ad1f49de82550ac5b11e84f99023cc900f4151c20c38a714d"}
Jul 16 12:48:10.587313 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.587053    2564 scope.go:117] "RemoveContainer" containerID="1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"
Jul 16 12:48:10.594397 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.594369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:10.595039 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.595023    2564 scope.go:117] "RemoveContainer" containerID="e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"
Jul 16 12:48:10.601723 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.601708    2564 scope.go:117] "RemoveContainer" containerID="aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"
Jul 16 12:48:10.608625 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.608608    2564 scope.go:117] "RemoveContainer" containerID="e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"
Jul 16 12:48:10.618033 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.618015    2564 scope.go:117] "RemoveContainer" containerID="fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"
Jul 16 12:48:10.618142 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.618064    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:48:10.625735 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.625715    2564 scope.go:117] "RemoveContainer" containerID="8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"
Jul 16 12:48:10.626275 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.626254    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:48:10.632681 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.632664    2564 scope.go:117] "RemoveContainer" containerID="15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096"
Jul 16 12:48:10.639193 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.639178    2564 scope.go:117] "RemoveContainer" containerID="1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"
Jul 16 12:48:10.639486 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:48:10.639464    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d\": container with ID starting with 1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d not found: ID does not exist" containerID="1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"
Jul 16 12:48:10.639544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.639495    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"} err="failed to get container status \"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d\": rpc error: code = NotFound desc = could not find container \"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d\": container with ID starting with 1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d not found: ID does not exist"
Jul 16 12:48:10.639544 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.639529    2564 scope.go:117] "RemoveContainer" containerID="e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"
Jul 16 12:48:10.639754 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:48:10.639733    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8\": container with ID starting with e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8 not found: ID does not exist" containerID="e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"
Jul 16 12:48:10.639795 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.639763    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"} err="failed to get container status \"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8\": rpc error: code = NotFound desc = could not find container \"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8\": container with ID starting with e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8 not found: ID does not exist"
Jul 16 12:48:10.639795 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.639779    2564 scope.go:117] "RemoveContainer" containerID="aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"
Jul 16 12:48:10.639987 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:48:10.639969    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa\": container with ID starting with aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa not found: ID does not exist" containerID="aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"
Jul 16 12:48:10.640042 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.639992    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"} err="failed to get container status \"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa\": rpc error: code = NotFound desc = could not find container \"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa\": container with ID starting with aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa not found: ID does not exist"
Jul 16 12:48:10.640042 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.640009    2564 scope.go:117] "RemoveContainer" containerID="e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"
Jul 16 12:48:10.640272 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:48:10.640256    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff\": container with ID starting with e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff not found: ID does not exist" containerID="e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"
Jul 16 12:48:10.640346 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.640281    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"} err="failed to get container status \"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff\": rpc error: code = NotFound desc = could not find container \"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff\": container with ID starting with e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff not found: ID does not exist"
Jul 16 12:48:10.640346 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.640302    2564 scope.go:117] "RemoveContainer" containerID="fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"
Jul 16 12:48:10.640518 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:48:10.640499    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e\": container with ID starting with fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e not found: ID does not exist" containerID="fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"
Jul 16 12:48:10.640555 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.640521    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"} err="failed to get container status \"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e\": rpc error: code = NotFound desc = could not find container \"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e\": container with ID starting with fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e not found: ID does not exist"
Jul 16 12:48:10.640555 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.640536    2564 scope.go:117] "RemoveContainer" containerID="8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"
Jul 16 12:48:10.640743 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:48:10.640728    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd\": container with ID starting with 8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd not found: ID does not exist" containerID="8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"
Jul 16 12:48:10.640801 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.640753    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"} err="failed to get container status \"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd\": rpc error: code = NotFound desc = could not find container \"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd\": container with ID starting with 8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd not found: ID does not exist"
Jul 16 12:48:10.640801 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.640772    2564 scope.go:117] "RemoveContainer" containerID="15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096"
Jul 16 12:48:10.641017 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:48:10.641001    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096\": container with ID starting with 15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096 not found: ID does not exist" containerID="15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096"
Jul 16 12:48:10.641054 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641023    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096"} err="failed to get container status \"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096\": rpc error: code = NotFound desc = could not find container \"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096\": container with ID starting with 15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096 not found: ID does not exist"
Jul 16 12:48:10.641054 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641037    2564 scope.go:117] "RemoveContainer" containerID="1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"
Jul 16 12:48:10.641280 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641263    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d"} err="failed to get container status \"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d\": rpc error: code = NotFound desc = could not find container \"1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d\": container with ID starting with 1d718be9640e874db66e83fba75340a3af544a382100385ac2508cfedadfb14d not found: ID does not exist"
Jul 16 12:48:10.641366 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641282    2564 scope.go:117] "RemoveContainer" containerID="e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"
Jul 16 12:48:10.641465 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641449    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8"} err="failed to get container status \"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8\": rpc error: code = NotFound desc = could not find container \"e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8\": container with ID starting with e0e01e6e571ea5c4598c71470821ed22ccd76f6cd68be293937784564881dee8 not found: ID does not exist"
Jul 16 12:48:10.641502 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641464    2564 scope.go:117] "RemoveContainer" containerID="aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"
Jul 16 12:48:10.641643 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641629    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa"} err="failed to get container status \"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa\": rpc error: code = NotFound desc = could not find container \"aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa\": container with ID starting with aeef122038c0e1347d07260e947d3e7009b2013b7267dd75ca703968cf4ef9fa not found: ID does not exist"
Jul 16 12:48:10.641691 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641643    2564 scope.go:117] "RemoveContainer" containerID="e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"
Jul 16 12:48:10.641830 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641814    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff"} err="failed to get container status \"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff\": rpc error: code = NotFound desc = could not find container \"e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff\": container with ID starting with e00e9e193b0cc5b1a234ae6ea924cc9afc21b4f2cb60ccacc67e78d58ba651ff not found: ID does not exist"
Jul 16 12:48:10.641874 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641830    2564 scope.go:117] "RemoveContainer" containerID="fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"
Jul 16 12:48:10.642004 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.641989    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e"} err="failed to get container status \"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e\": rpc error: code = NotFound desc = could not find container \"fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e\": container with ID starting with fea11a52dfcbd977867316f8f687d3d461352d2f1dae8885f39722b1b69b217e not found: ID does not exist"
Jul 16 12:48:10.642049 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.642004    2564 scope.go:117] "RemoveContainer" containerID="8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"
Jul 16 12:48:10.642216 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.642195    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd"} err="failed to get container status \"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd\": rpc error: code = NotFound desc = could not find container \"8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd\": container with ID starting with 8c46fd91bb2fd74105e828672dc9d2075354f5258894c43f559c0db261b95ebd not found: ID does not exist"
Jul 16 12:48:10.642293 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.642217    2564 scope.go:117] "RemoveContainer" containerID="15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096"
Jul 16 12:48:10.642407 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.642390    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096"} err="failed to get container status \"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096\": rpc error: code = NotFound desc = could not find container \"15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096\": container with ID starting with 15cd1c43ed16184e4ca66f129cbd509d1040e5cfb5951a636df5de9beffe6096 not found: ID does not exist"
Jul 16 12:48:10.678599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678571    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:48:10.678808 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678797    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="prom-label-proxy"
Jul 16 12:48:10.678861 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678810    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="prom-label-proxy"
Jul 16 12:48:10.678861 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678827    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="init-config-reloader"
Jul 16 12:48:10.678861 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678833    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="init-config-reloader"
Jul 16 12:48:10.678861 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678841    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="alertmanager"
Jul 16 12:48:10.678861 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678846    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="alertmanager"
Jul 16 12:48:10.678861 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678853    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-metric"
Jul 16 12:48:10.678861 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678858    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-metric"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678866    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="config-reloader"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678872    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="config-reloader"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678880    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-web"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678886    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-web"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678894    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678900    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678937    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="config-reloader"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678944    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678950    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-metric"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678956    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="alertmanager"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678961    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="prom-label-proxy"
Jul 16 12:48:10.679088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.678968    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" containerName="kube-rbac-proxy-web"
Jul 16 12:48:10.683806 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.683789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.686454 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686436    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 12:48:10.686551 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686482    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c8qvd\""
Jul 16 12:48:10.686551 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 12:48:10.686672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686555    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 12:48:10.686775 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686758    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 12:48:10.686853 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686802    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 12:48:10.686911 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686871    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 12:48:10.686967 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.686925    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 12:48:10.687035 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.687014    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 12:48:10.694962 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.694941    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 12:48:10.700233 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.700215    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:48:10.708444 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.708419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:10.832183 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.832155    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d23adf-ab3b-415e-87d5-5c25acffd2b3" path="/var/lib/kubelet/pods/a1d23adf-ab3b-415e-87d5-5c25acffd2b3/volumes"
Jul 16 12:48:10.853288 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853288 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853288 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw6rb\" (UniqueName: \"kubernetes.io/projected/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-kube-api-access-hw6rb\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-config-out\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853616 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853616 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-web-config\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853616 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853616 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.853616 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.853602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954506 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954506 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954681 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954681 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954753 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954753 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw6rb\" (UniqueName: \"kubernetes.io/projected/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-kube-api-access-hw6rb\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954837 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-config-out\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954837 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954837 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.954985 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.954937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-web-config\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.956596 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.956568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.957031 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.957006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.957702 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.957668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.957820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.957751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.957820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.957766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.957820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.957778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-web-config\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.957820 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.957788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.958063 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.957829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.958155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.958137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-config-out\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.958275 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.958259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.959561 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.959545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.959635 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.959619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.965216 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.965198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw6rb\" (UniqueName: \"kubernetes.io/projected/b15d9fba-1fc5-4989-8803-c6c8fabc2c5b-kube-api-access-hw6rb\") pod \"alertmanager-main-0\" (UID: \"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:10.993019 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:10.992995    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:48:11.133373 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:11.133299    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:48:11.136442 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:48:11.136414    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15d9fba_1fc5_4989_8803_c6c8fabc2c5b.slice/crio-ca83e017b32ebff993574aab6604920367a327484e780b2bad7305a4d538abb3 WatchSource:0}: Error finding container ca83e017b32ebff993574aab6604920367a327484e780b2bad7305a4d538abb3: Status 404 returned error can't find the container with id ca83e017b32ebff993574aab6604920367a327484e780b2bad7305a4d538abb3
Jul 16 12:48:11.593403 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:11.593365    2564 generic.go:356] "Generic (PLEG): container finished" podID="b15d9fba-1fc5-4989-8803-c6c8fabc2c5b" containerID="aa1233d0cfb250b86e07e53cb337af2f37f5b5ae39a4a2fb24cf38c8f34efc12" exitCode=0
Jul 16 12:48:11.593766 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:11.593410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerDied","Data":"aa1233d0cfb250b86e07e53cb337af2f37f5b5ae39a4a2fb24cf38c8f34efc12"}
Jul 16 12:48:11.593766 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:11.593502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerStarted","Data":"ca83e017b32ebff993574aab6604920367a327484e780b2bad7305a4d538abb3"}
Jul 16 12:48:12.600447 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:12.600418    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerStarted","Data":"6800245fc6e1cf00d701bb2086e603149c3ed165879d48380409f15f6ff87470"}
Jul 16 12:48:12.600838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:12.600479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerStarted","Data":"b0c3ca944dae3c8d47634df1966ecf8cecba746cb481f4ec39763501284a3389"}
Jul 16 12:48:12.600838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:12.600506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerStarted","Data":"8699a156c6a9d067d237be90df1b545a8ca98306f244ae522ff064a90989056e"}
Jul 16 12:48:12.600838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:12.600529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerStarted","Data":"30acaa0eef770e98491322bfba62d1b4e4ef0c1057b56c0628624ee6af62da51"}
Jul 16 12:48:12.600838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:12.600551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerStarted","Data":"7585a9648ecd8feb2a7ee6b5f43ab564ecba39dfd198acb25e0ab41944c9ea6d"}
Jul 16 12:48:12.600838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:12.600574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b15d9fba-1fc5-4989-8803-c6c8fabc2c5b","Type":"ContainerStarted","Data":"6a1af8a137d0cb0269a38f6d9002a5765d9761f2b1ad2cc6748b226ed9feafa0"}
Jul 16 12:48:12.651076 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:12.650904    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.632728813 podStartE2EDuration="2.650882796s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.153983ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:48:12.642721329 +0000 UTC m=+176.381711108" watchObservedRunningTime="2026-07-16 12:48:12.650882796 +0000 UTC m=+176.389872577"
Jul 16 12:48:16.212964 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:16.212927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:16.366077 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:16.366044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:21.683097 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:21.683063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:21.784042 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:21.783993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:21.893997 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:21.893963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:22.858892 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:22.858852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:22.958857 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:22.958829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:23.045688 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:48:23.045642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:04.782550 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:04.782514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:30.103624 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:30.103587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:30.203019 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:30.202984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:35.209236 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:35.209191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:52.339818 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:52.339724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:52.684244 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:52.684102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:56.344980 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:56.344943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:56.455891 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:56.455863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:57.981542 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:57.981495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:58.201222 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:58.201193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:58.318016 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:58.317936    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:58.503087 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:58.503039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:58.635285 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:49:58.635255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:00.460200 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:00.460153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:00.832613 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:00.832528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:03.380542 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:03.380510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:03.496214 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:03.496171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.028505 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.028469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.164977 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.164943    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5hfds"]
Jul 16 12:50:09.167917 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.167899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.170522 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.170501    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 12:50:09.170646 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.170625    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jklpl\""
Jul 16 12:50:09.171621 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.171602    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 12:50:09.179650 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.179628    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5hfds"]
Jul 16 12:50:09.222126 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.222080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxls9\" (UniqueName: \"kubernetes.io/projected/b4fbbdf0-f6b2-4983-8fbc-6994df641876-kube-api-access-zxls9\") pod \"cert-manager-55b4d954d5-5hfds\" (UID: \"b4fbbdf0-f6b2-4983-8fbc-6994df641876\") " pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.222266 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.222143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4fbbdf0-f6b2-4983-8fbc-6994df641876-bound-sa-token\") pod \"cert-manager-55b4d954d5-5hfds\" (UID: \"b4fbbdf0-f6b2-4983-8fbc-6994df641876\") " pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.323138 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.323043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxls9\" (UniqueName: \"kubernetes.io/projected/b4fbbdf0-f6b2-4983-8fbc-6994df641876-kube-api-access-zxls9\") pod \"cert-manager-55b4d954d5-5hfds\" (UID: \"b4fbbdf0-f6b2-4983-8fbc-6994df641876\") " pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.323138 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.323087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4fbbdf0-f6b2-4983-8fbc-6994df641876-bound-sa-token\") pod \"cert-manager-55b4d954d5-5hfds\" (UID: \"b4fbbdf0-f6b2-4983-8fbc-6994df641876\") " pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.332429 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.332405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4fbbdf0-f6b2-4983-8fbc-6994df641876-bound-sa-token\") pod \"cert-manager-55b4d954d5-5hfds\" (UID: \"b4fbbdf0-f6b2-4983-8fbc-6994df641876\") " pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.332546 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.332529    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxls9\" (UniqueName: \"kubernetes.io/projected/b4fbbdf0-f6b2-4983-8fbc-6994df641876-kube-api-access-zxls9\") pod \"cert-manager-55b4d954d5-5hfds\" (UID: \"b4fbbdf0-f6b2-4983-8fbc-6994df641876\") " pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.476782 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.476736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5hfds"
Jul 16 12:50:09.604265 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:09.604240    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5hfds"]
Jul 16 12:50:09.606752 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:50:09.606720    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4fbbdf0_f6b2_4983_8fbc_6994df641876.slice/crio-f0d9de004919d2aa9bafe07423157326b1dbd9a2e6222d67278ffd3b453b457d WatchSource:0}: Error finding container f0d9de004919d2aa9bafe07423157326b1dbd9a2e6222d67278ffd3b453b457d: Status 404 returned error can't find the container with id f0d9de004919d2aa9bafe07423157326b1dbd9a2e6222d67278ffd3b453b457d
Jul 16 12:50:10.006553 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:10.006471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5hfds" event={"ID":"b4fbbdf0-f6b2-4983-8fbc-6994df641876","Type":"ContainerStarted","Data":"f0d9de004919d2aa9bafe07423157326b1dbd9a2e6222d67278ffd3b453b457d"}
Jul 16 12:50:10.837434 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:10.837360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:10.935726 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:10.935645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:13.025245 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:13.025210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5hfds" event={"ID":"b4fbbdf0-f6b2-4983-8fbc-6994df641876","Type":"ContainerStarted","Data":"4a17ea6d95366a93f3a8f6c7761e0b19acf3ce09e78c17e78a84e9f0aa0caad7"}
Jul 16 12:50:13.045158 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:13.045033    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5hfds" podStartSLOduration=1.114791438 podStartE2EDuration="4.045014173s" totalImagesPullingTime="2.930222735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:50:13.044615661 +0000 UTC m=+296.783605461" watchObservedRunningTime="2026-07-16 12:50:13.045014173 +0000 UTC m=+296.784003953"
Jul 16 12:50:16.636776 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:16.636749    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 12:50:16.736378 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:16.736342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:16.849251 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:16.849224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:19.278514 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:19.278479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:34.356166 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:34.356096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:34.609579 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:34.609487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:34.969685 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:34.969598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:35.065502 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.065471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:35.422867 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.422824    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"]
Jul 16 12:50:35.427416 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.427398    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.429951 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.429915    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 12:50:35.429951 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.429936    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v8qn5\""
Jul 16 12:50:35.429951 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.429937    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 12:50:35.430295 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.429943    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 12:50:35.431039 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.431019    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 12:50:35.442849 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.442828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"]
Jul 16 12:50:35.516981 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.516945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acfe6a99-c379-4605-8f0c-0bf32e1841fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.516981 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.516983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acfe6a99-c379-4605-8f0c-0bf32e1841fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.517253 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.517015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acfe6a99-c379-4605-8f0c-0bf32e1841fb-tmp\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.517253 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.517135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acfe6a99-c379-4605-8f0c-0bf32e1841fb-manifests\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.517253 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.517172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llzbp\" (UniqueName: \"kubernetes.io/projected/acfe6a99-c379-4605-8f0c-0bf32e1841fb-kube-api-access-llzbp\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.534412 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.534375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:35.617929 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.617896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acfe6a99-c379-4605-8f0c-0bf32e1841fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.617929 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.617932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acfe6a99-c379-4605-8f0c-0bf32e1841fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.618128 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.617963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acfe6a99-c379-4605-8f0c-0bf32e1841fb-tmp\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.618128 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.618001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acfe6a99-c379-4605-8f0c-0bf32e1841fb-manifests\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.618128 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.618019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llzbp\" (UniqueName: \"kubernetes.io/projected/acfe6a99-c379-4605-8f0c-0bf32e1841fb-kube-api-access-llzbp\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.618476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.618453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acfe6a99-c379-4605-8f0c-0bf32e1841fb-manifests\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.620308 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.620287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acfe6a99-c379-4605-8f0c-0bf32e1841fb-tmp\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.620520 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.620503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acfe6a99-c379-4605-8f0c-0bf32e1841fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.620682 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.620659    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acfe6a99-c379-4605-8f0c-0bf32e1841fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.629075 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.629055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llzbp\" (UniqueName: \"kubernetes.io/projected/acfe6a99-c379-4605-8f0c-0bf32e1841fb-kube-api-access-llzbp\") pod \"opendatahub-operator-controller-manager-9d668944c-7cjzb\" (UID: \"acfe6a99-c379-4605-8f0c-0bf32e1841fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.649716 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.649681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:35.736959 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.736884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:35.752745 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.752709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:35.862401 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.862341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:35.868156 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.867700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"]
Jul 16 12:50:35.872721 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:50:35.872696    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfe6a99_c379_4605_8f0c_0bf32e1841fb.slice/crio-6f533f6d367be4a0b3be79925461d37576e1bf141ed1837a590384699fc06346 WatchSource:0}: Error finding container 6f533f6d367be4a0b3be79925461d37576e1bf141ed1837a590384699fc06346: Status 404 returned error can't find the container with id 6f533f6d367be4a0b3be79925461d37576e1bf141ed1837a590384699fc06346
Jul 16 12:50:35.874467 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.874454    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:50:35.962486 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:35.962451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:36.063587 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:36.063495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:36.108077 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:36.108047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb" event={"ID":"acfe6a99-c379-4605-8f0c-0bf32e1841fb","Type":"ContainerStarted","Data":"6f533f6d367be4a0b3be79925461d37576e1bf141ed1837a590384699fc06346"}
Jul 16 12:50:39.122207 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:39.122174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb" event={"ID":"acfe6a99-c379-4605-8f0c-0bf32e1841fb","Type":"ContainerStarted","Data":"f0204d9e6ac41209a739e0f0179dcaa0fb2fb01edbef2984c957660348d86755"}
Jul 16 12:50:39.857123 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:39.857080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:40.127398 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:40.127364    2564 generic.go:356] "Generic (PLEG): container finished" podID="acfe6a99-c379-4605-8f0c-0bf32e1841fb" containerID="f0204d9e6ac41209a739e0f0179dcaa0fb2fb01edbef2984c957660348d86755" exitCode=0
Jul 16 12:50:40.127758 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:40.127412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb" event={"ID":"acfe6a99-c379-4605-8f0c-0bf32e1841fb","Type":"ContainerDied","Data":"f0204d9e6ac41209a739e0f0179dcaa0fb2fb01edbef2984c957660348d86755"}
Jul 16 12:50:41.133310 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:41.133272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb" event={"ID":"acfe6a99-c379-4605-8f0c-0bf32e1841fb","Type":"ContainerStarted","Data":"67044b733b077b7ae54fa532781c7db64b18288d55ba2028a97ae0d26cd0f44d"}
Jul 16 12:50:41.133661 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:41.133402    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:49.390087 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:49.390052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:49.497208 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:49.497168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:52.139159 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:52.139130    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb"
Jul 16 12:50:52.173643 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:52.173585    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9d668944c-7cjzb" podStartSLOduration=12.455839487 podStartE2EDuration="17.173563489s" totalImagesPullingTime="3.698709092s" totalInitContainerRuntime="1.01901491s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:50:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:50:41.183831115 +0000 UTC m=+324.922820893" watchObservedRunningTime="2026-07-16 12:50:52.173563489 +0000 UTC m=+335.912553268"
Jul 16 12:50:55.283505 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:55.283451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:55.445824 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:55.445788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:56.009616 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.009581    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rht72"]
Jul 16 12:50:56.017891 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.017860    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.024912 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.024889    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f4fzj\""
Jul 16 12:50:56.025206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.025192    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 12:50:56.094315 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.094283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c0d85c-c3f3-4ee3-a486-170aa0041584-cert\") pod \"odh-model-controller-7998c67dc4-rht72\" (UID: \"50c0d85c-c3f3-4ee3-a486-170aa0041584\") " pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.094462 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.094337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcpj\" (UniqueName: \"kubernetes.io/projected/50c0d85c-c3f3-4ee3-a486-170aa0041584-kube-api-access-2wcpj\") pod \"odh-model-controller-7998c67dc4-rht72\" (UID: \"50c0d85c-c3f3-4ee3-a486-170aa0041584\") " pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.137155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.137124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:56.177049 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.177010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rht72"]
Jul 16 12:50:56.195386 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.195360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c0d85c-c3f3-4ee3-a486-170aa0041584-cert\") pod \"odh-model-controller-7998c67dc4-rht72\" (UID: \"50c0d85c-c3f3-4ee3-a486-170aa0041584\") " pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.195527 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.195403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcpj\" (UniqueName: \"kubernetes.io/projected/50c0d85c-c3f3-4ee3-a486-170aa0041584-kube-api-access-2wcpj\") pod \"odh-model-controller-7998c67dc4-rht72\" (UID: \"50c0d85c-c3f3-4ee3-a486-170aa0041584\") " pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.195527 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:50:56.195514    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 16 12:50:56.195602 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:50:56.195594    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c0d85c-c3f3-4ee3-a486-170aa0041584-cert podName:50c0d85c-c3f3-4ee3-a486-170aa0041584 nodeName:}" failed. No retries permitted until 2026-07-16 12:50:56.695572462 +0000 UTC m=+340.434562224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/50c0d85c-c3f3-4ee3-a486-170aa0041584-cert") pod "odh-model-controller-7998c67dc4-rht72" (UID: "50c0d85c-c3f3-4ee3-a486-170aa0041584") : secret "odh-model-controller-webhook-cert" not found
Jul 16 12:50:56.227832 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.227806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wcpj\" (UniqueName: \"kubernetes.io/projected/50c0d85c-c3f3-4ee3-a486-170aa0041584-kube-api-access-2wcpj\") pod \"odh-model-controller-7998c67dc4-rht72\" (UID: \"50c0d85c-c3f3-4ee3-a486-170aa0041584\") " pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.389391 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.389359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:56.550264 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.550189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:56.699970 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.699882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c0d85c-c3f3-4ee3-a486-170aa0041584-cert\") pod \"odh-model-controller-7998c67dc4-rht72\" (UID: \"50c0d85c-c3f3-4ee3-a486-170aa0041584\") " pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.702240 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.702220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c0d85c-c3f3-4ee3-a486-170aa0041584-cert\") pod \"odh-model-controller-7998c67dc4-rht72\" (UID: \"50c0d85c-c3f3-4ee3-a486-170aa0041584\") " pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:56.927002 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:56.926971    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:50:57.037158 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.037125    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7w6cl"]
Jul 16 12:50:57.045326 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.045295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.048159 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.048087    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 12:50:57.055681 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.055655    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7w6cl"]
Jul 16 12:50:57.087461 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.087438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rht72"]
Jul 16 12:50:57.090073 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:50:57.090048    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c0d85c_c3f3_4ee3_a486_170aa0041584.slice/crio-db8275a2dd60791c065623cedc8c91a5ebefcf7e8820c856a2c2dd37c345f567 WatchSource:0}: Error finding container db8275a2dd60791c065623cedc8c91a5ebefcf7e8820c856a2c2dd37c345f567: Status 404 returned error can't find the container with id db8275a2dd60791c065623cedc8c91a5ebefcf7e8820c856a2c2dd37c345f567
Jul 16 12:50:57.102348 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.102320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfvmz\" (UniqueName: \"kubernetes.io/projected/cc753de1-bd18-4e22-b04f-d74a33f2ea80-kube-api-access-cfvmz\") pod \"model-serving-api-54d89bd5fc-7w6cl\" (UID: \"cc753de1-bd18-4e22-b04f-d74a33f2ea80\") " pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.102454 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.102433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc753de1-bd18-4e22-b04f-d74a33f2ea80-tls-certs\") pod \"model-serving-api-54d89bd5fc-7w6cl\" (UID: \"cc753de1-bd18-4e22-b04f-d74a33f2ea80\") " pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.191152 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.191096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rht72" event={"ID":"50c0d85c-c3f3-4ee3-a486-170aa0041584","Type":"ContainerStarted","Data":"db8275a2dd60791c065623cedc8c91a5ebefcf7e8820c856a2c2dd37c345f567"}
Jul 16 12:50:57.197264 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.197236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:57.203281 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.203253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc753de1-bd18-4e22-b04f-d74a33f2ea80-tls-certs\") pod \"model-serving-api-54d89bd5fc-7w6cl\" (UID: \"cc753de1-bd18-4e22-b04f-d74a33f2ea80\") " pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.203385 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.203294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfvmz\" (UniqueName: \"kubernetes.io/projected/cc753de1-bd18-4e22-b04f-d74a33f2ea80-kube-api-access-cfvmz\") pod \"model-serving-api-54d89bd5fc-7w6cl\" (UID: \"cc753de1-bd18-4e22-b04f-d74a33f2ea80\") " pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.205729 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.205706    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc753de1-bd18-4e22-b04f-d74a33f2ea80-tls-certs\") pod \"model-serving-api-54d89bd5fc-7w6cl\" (UID: \"cc753de1-bd18-4e22-b04f-d74a33f2ea80\") " pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.212901 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.212877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfvmz\" (UniqueName: \"kubernetes.io/projected/cc753de1-bd18-4e22-b04f-d74a33f2ea80-kube-api-access-cfvmz\") pod \"model-serving-api-54d89bd5fc-7w6cl\" (UID: \"cc753de1-bd18-4e22-b04f-d74a33f2ea80\") " pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.306879 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.306809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:57.357599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.357571    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:50:57.487286 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:57.487262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7w6cl"]
Jul 16 12:50:57.489283 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:50:57.489253    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc753de1_bd18_4e22_b04f_d74a33f2ea80.slice/crio-3d4112b0d3bff5ac30aa4aecc0ab78b801f34a5bbb644a12aa0da7f531705164 WatchSource:0}: Error finding container 3d4112b0d3bff5ac30aa4aecc0ab78b801f34a5bbb644a12aa0da7f531705164: Status 404 returned error can't find the container with id 3d4112b0d3bff5ac30aa4aecc0ab78b801f34a5bbb644a12aa0da7f531705164
Jul 16 12:50:58.196646 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:50:58.196606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl" event={"ID":"cc753de1-bd18-4e22-b04f-d74a33f2ea80","Type":"ContainerStarted","Data":"3d4112b0d3bff5ac30aa4aecc0ab78b801f34a5bbb644a12aa0da7f531705164"}
Jul 16 12:51:01.209735 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:01.209703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rht72" event={"ID":"50c0d85c-c3f3-4ee3-a486-170aa0041584","Type":"ContainerStarted","Data":"7e587d7ba001f77a02d30db07a459f131529f260f5cb57ff53dbe1494ce49fd1"}
Jul 16 12:51:01.210175 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:01.209824    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:51:01.211238 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:01.211215    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl" event={"ID":"cc753de1-bd18-4e22-b04f-d74a33f2ea80","Type":"ContainerStarted","Data":"8a055839b7474ad5568028e37e6b01c38b2101334db8324b755570fc60c05e3f"}
Jul 16 12:51:01.211319 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:01.211268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:51:01.230625 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:01.230577    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rht72" podStartSLOduration=2.944227171 podStartE2EDuration="6.230562826s" totalImagesPullingTime="3.286335655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:51:01.22938961 +0000 UTC m=+344.968379389" watchObservedRunningTime="2026-07-16 12:51:01.230562826 +0000 UTC m=+344.969552605"
Jul 16 12:51:01.252232 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:01.252190    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl" podStartSLOduration=1.368646547 podStartE2EDuration="4.252174846s" totalImagesPullingTime="2.883528299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:51:01.251451442 +0000 UTC m=+344.990441220" watchObservedRunningTime="2026-07-16 12:51:01.252174846 +0000 UTC m=+344.991164624"
Jul 16 12:51:06.073510 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.073470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.177660 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.177628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.207103 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.207071    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"]
Jul 16 12:51:06.209918 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.209901    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.216645 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.216569    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 12:51:06.217574 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.217503    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qhld5\""
Jul 16 12:51:06.223881 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.223855    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"]
Jul 16 12:51:06.227187 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.227159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.232312 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.232294    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 12:51:06.232637 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.232397    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pwqcm\""
Jul 16 12:51:06.233410 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.233387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"]
Jul 16 12:51:06.261735 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.261705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"]
Jul 16 12:51:06.275932 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.275902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b885a09-9890-4c4d-9834-71ff926031af-cert\") pod \"kserve-controller-manager-d6f4b65b8-7rs4d\" (UID: \"0b885a09-9890-4c4d-9834-71ff926031af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.276050 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.275958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bkz\" (UniqueName: \"kubernetes.io/projected/0b885a09-9890-4c4d-9834-71ff926031af-kube-api-access-j4bkz\") pod \"kserve-controller-manager-d6f4b65b8-7rs4d\" (UID: \"0b885a09-9890-4c4d-9834-71ff926031af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.276050 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.275988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2kc4\" (UniqueName: \"kubernetes.io/projected/b2de5e96-d219-403b-9349-5b33199060a7-kube-api-access-m2kc4\") pod \"llmisvc-controller-manager-777c6bd7d5-sz4th\" (UID: \"b2de5e96-d219-403b-9349-5b33199060a7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.276050 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.276032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2de5e96-d219-403b-9349-5b33199060a7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sz4th\" (UID: \"b2de5e96-d219-403b-9349-5b33199060a7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.291198 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.291168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.376697 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.376666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b885a09-9890-4c4d-9834-71ff926031af-cert\") pod \"kserve-controller-manager-d6f4b65b8-7rs4d\" (UID: \"0b885a09-9890-4c4d-9834-71ff926031af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.376883 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.376710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bkz\" (UniqueName: \"kubernetes.io/projected/0b885a09-9890-4c4d-9834-71ff926031af-kube-api-access-j4bkz\") pod \"kserve-controller-manager-d6f4b65b8-7rs4d\" (UID: \"0b885a09-9890-4c4d-9834-71ff926031af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.376883 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.376731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2kc4\" (UniqueName: \"kubernetes.io/projected/b2de5e96-d219-403b-9349-5b33199060a7-kube-api-access-m2kc4\") pod \"llmisvc-controller-manager-777c6bd7d5-sz4th\" (UID: \"b2de5e96-d219-403b-9349-5b33199060a7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.376883 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.376838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2de5e96-d219-403b-9349-5b33199060a7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sz4th\" (UID: \"b2de5e96-d219-403b-9349-5b33199060a7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.377045 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:51:06.376899    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 16 12:51:06.377045 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:51:06.376971    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b885a09-9890-4c4d-9834-71ff926031af-cert podName:0b885a09-9890-4c4d-9834-71ff926031af nodeName:}" failed. No retries permitted until 2026-07-16 12:51:06.876947719 +0000 UTC m=+350.615937493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b885a09-9890-4c4d-9834-71ff926031af-cert") pod "kserve-controller-manager-d6f4b65b8-7rs4d" (UID: "0b885a09-9890-4c4d-9834-71ff926031af") : secret "kserve-webhook-server-cert" not found
Jul 16 12:51:06.377045 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:51:06.376996    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 16 12:51:06.377218 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:51:06.377058    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2de5e96-d219-403b-9349-5b33199060a7-cert podName:b2de5e96-d219-403b-9349-5b33199060a7 nodeName:}" failed. No retries permitted until 2026-07-16 12:51:06.877040005 +0000 UTC m=+350.616029771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2de5e96-d219-403b-9349-5b33199060a7-cert") pod "llmisvc-controller-manager-777c6bd7d5-sz4th" (UID: "b2de5e96-d219-403b-9349-5b33199060a7") : secret "llmisvc-webhook-server-cert" not found
Jul 16 12:51:06.392195 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.392164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bkz\" (UniqueName: \"kubernetes.io/projected/0b885a09-9890-4c4d-9834-71ff926031af-kube-api-access-j4bkz\") pod \"kserve-controller-manager-d6f4b65b8-7rs4d\" (UID: \"0b885a09-9890-4c4d-9834-71ff926031af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.396527 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.396500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2kc4\" (UniqueName: \"kubernetes.io/projected/b2de5e96-d219-403b-9349-5b33199060a7-kube-api-access-m2kc4\") pod \"llmisvc-controller-manager-777c6bd7d5-sz4th\" (UID: \"b2de5e96-d219-403b-9349-5b33199060a7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.457586 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.457541    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.566369 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.566338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.657170 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.657070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.693161 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.693128    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"]
Jul 16 12:51:06.696523 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.696505    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.708892 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.708872    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 12:51:06.708892 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.708879    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 12:51:06.709075 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.709016    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 12:51:06.709075 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.709029    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 12:51:06.709538 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.709523    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c9sjb\""
Jul 16 12:51:06.735776 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.735744    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"]
Jul 16 12:51:06.779706 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.779680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa831b28-d565-4888-a419-cd7dbfac718d-tmp\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.779905 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.779749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5skl\" (UniqueName: \"kubernetes.io/projected/aa831b28-d565-4888-a419-cd7dbfac718d-kube-api-access-m5skl\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.779905 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.779812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa831b28-d565-4888-a419-cd7dbfac718d-tls-certs\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.791473 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.791438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.881194 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.881160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5skl\" (UniqueName: \"kubernetes.io/projected/aa831b28-d565-4888-a419-cd7dbfac718d-kube-api-access-m5skl\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.881409 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.881247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa831b28-d565-4888-a419-cd7dbfac718d-tls-certs\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.881409 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.881280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b885a09-9890-4c4d-9834-71ff926031af-cert\") pod \"kserve-controller-manager-d6f4b65b8-7rs4d\" (UID: \"0b885a09-9890-4c4d-9834-71ff926031af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.881409 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.881320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa831b28-d565-4888-a419-cd7dbfac718d-tmp\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.881409 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.881362    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2de5e96-d219-403b-9349-5b33199060a7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sz4th\" (UID: \"b2de5e96-d219-403b-9349-5b33199060a7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.883171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.883128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:06.883959 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.883930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa831b28-d565-4888-a419-cd7dbfac718d-tmp\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.884129 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.884073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2de5e96-d219-403b-9349-5b33199060a7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sz4th\" (UID: \"b2de5e96-d219-403b-9349-5b33199060a7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:06.884235 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.884219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b885a09-9890-4c4d-9834-71ff926031af-cert\") pod \"kserve-controller-manager-d6f4b65b8-7rs4d\" (UID: \"0b885a09-9890-4c4d-9834-71ff926031af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:06.884277 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.884239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa831b28-d565-4888-a419-cd7dbfac718d-tls-certs\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:06.892802 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:06.892776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5skl\" (UniqueName: \"kubernetes.io/projected/aa831b28-d565-4888-a419-cd7dbfac718d-kube-api-access-m5skl\") pod \"kube-auth-proxy-d67ccd5b7-vkk28\" (UID: \"aa831b28-d565-4888-a419-cd7dbfac718d\") " pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:07.013376 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:07.013273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"
Jul 16 12:51:07.121633 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:07.121602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:07.140863 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:07.140832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:07.150085 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:07.150059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28"]
Jul 16 12:51:07.153026 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:51:07.153004    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa831b28_d565_4888_a419_cd7dbfac718d.slice/crio-916df2a04b97c550418360ba4fc95299c60a3ca774935247bc64e7628b4ddb32 WatchSource:0}: Error finding container 916df2a04b97c550418360ba4fc95299c60a3ca774935247bc64e7628b4ddb32: Status 404 returned error can't find the container with id 916df2a04b97c550418360ba4fc95299c60a3ca774935247bc64e7628b4ddb32
Jul 16 12:51:07.236028 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:07.235996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28" event={"ID":"aa831b28-d565-4888-a419-cd7dbfac718d","Type":"ContainerStarted","Data":"916df2a04b97c550418360ba4fc95299c60a3ca774935247bc64e7628b4ddb32"}
Jul 16 12:51:07.269422 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:07.269398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"]
Jul 16 12:51:07.271579 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:51:07.271548    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b885a09_9890_4c4d_9834_71ff926031af.slice/crio-cf4a37e5a84f3e63f3193055b311e8b32a6a975ebe7627cee58146020aa91532 WatchSource:0}: Error finding container cf4a37e5a84f3e63f3193055b311e8b32a6a975ebe7627cee58146020aa91532: Status 404 returned error can't find the container with id cf4a37e5a84f3e63f3193055b311e8b32a6a975ebe7627cee58146020aa91532
Jul 16 12:51:07.292370 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:07.292349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"]
Jul 16 12:51:08.244070 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:08.243943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th" event={"ID":"b2de5e96-d219-403b-9349-5b33199060a7","Type":"ContainerStarted","Data":"a57149b94407500aa2b3e006bc2f6efe8af579fc8a099051e130daff42789d6b"}
Jul 16 12:51:08.245594 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:08.245564    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d" event={"ID":"0b885a09-9890-4c4d-9834-71ff926031af","Type":"ContainerStarted","Data":"cf4a37e5a84f3e63f3193055b311e8b32a6a975ebe7627cee58146020aa91532"}
Jul 16 12:51:09.197506 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.197468    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"]
Jul 16 12:51:09.201392 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.201215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.204375 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.204345    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 12:51:09.204943 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.204704    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 12:51:09.204943 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.204773    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 12:51:09.204943 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.204715    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 12:51:09.206367 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.206015    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4kxlr\""
Jul 16 12:51:09.230088 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.230060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"]
Jul 16 12:51:09.242773 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.242657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:09.304509 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.304474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.304509 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.304513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.304963 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.304561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.304963 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.304586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cm9h\" (UniqueName: \"kubernetes.io/projected/fb816cf6-da84-4bb5-bee7-a697e84ed531-kube-api-access-5cm9h\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.304963 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.304666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb816cf6-da84-4bb5-bee7-a697e84ed531-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.304963 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.304733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.304963 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.304765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.367375 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.367315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:09.406231 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.406190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.406420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.406248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.406420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.406300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.406420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.406337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cm9h\" (UniqueName: \"kubernetes.io/projected/fb816cf6-da84-4bb5-bee7-a697e84ed531-kube-api-access-5cm9h\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.406420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.406396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb816cf6-da84-4bb5-bee7-a697e84ed531-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.406640 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.406440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.406640 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.406466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.407150 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.407071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.409361 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.409309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.409469 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.409403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.409914 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.409880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb816cf6-da84-4bb5-bee7-a697e84ed531-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.410460 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.410429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.420634 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.420527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb816cf6-da84-4bb5-bee7-a697e84ed531-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.422007 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.421982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cm9h\" (UniqueName: \"kubernetes.io/projected/fb816cf6-da84-4bb5-bee7-a697e84ed531-kube-api-access-5cm9h\") pod \"istiod-openshift-gateway-94bb8fbfd-bkwr2\" (UID: \"fb816cf6-da84-4bb5-bee7-a697e84ed531\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:09.524252 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:09.524156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:11.163594 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.163569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:11.263572 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.263282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28" event={"ID":"aa831b28-d565-4888-a419-cd7dbfac718d","Type":"ContainerStarted","Data":"e6df8d36d34bab6ea07997077683175e3bef5c2d52fe3ed889f0ee3970696eea"}
Jul 16 12:51:11.265319 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.265282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th" event={"ID":"b2de5e96-d219-403b-9349-5b33199060a7","Type":"ContainerStarted","Data":"916aa1529cea126978b63b297a2020996588a8b2b6e2f90716ef0698b08e7758"}
Jul 16 12:51:11.265480 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.265371    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:11.266928 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.266854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d" event={"ID":"0b885a09-9890-4c4d-9834-71ff926031af","Type":"ContainerStarted","Data":"afe6c806cc63013af5a8dc6c388d8dd3dc40961b924ccfea68ae1299fbf71131"}
Jul 16 12:51:11.267052 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.267005    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:11.274855 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.274761    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"]
Jul 16 12:51:11.277795 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:51:11.277746    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb816cf6_da84_4bb5_bee7_a697e84ed531.slice/crio-99898296fdfac6a84f85adf0a98c0f93374e73795fc877e03183a7991f317585 WatchSource:0}: Error finding container 99898296fdfac6a84f85adf0a98c0f93374e73795fc877e03183a7991f317585: Status 404 returned error can't find the container with id 99898296fdfac6a84f85adf0a98c0f93374e73795fc877e03183a7991f317585
Jul 16 12:51:11.286218 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.286179    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d67ccd5b7-vkk28" podStartSLOduration=1.308645266 podStartE2EDuration="5.286165368s" totalImagesPullingTime="3.977520102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:51:11.284683376 +0000 UTC m=+355.023673146" watchObservedRunningTime="2026-07-16 12:51:11.286165368 +0000 UTC m=+355.025155147"
Jul 16 12:51:11.311679 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.311624    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th" podStartSLOduration=1.473920058 podStartE2EDuration="5.31160785s" totalImagesPullingTime="3.837687792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:51:11.310947651 +0000 UTC m=+355.049937429" watchObservedRunningTime="2026-07-16 12:51:11.31160785 +0000 UTC m=+355.050597630"
Jul 16 12:51:11.339362 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:11.339299    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d" podStartSLOduration=1.483280397 podStartE2EDuration="5.3392773s" totalImagesPullingTime="3.855996903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:51:11.337452426 +0000 UTC m=+355.076442207" watchObservedRunningTime="2026-07-16 12:51:11.3392773 +0000 UTC m=+355.078267152"
Jul 16 12:51:12.218598 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:12.218564    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7w6cl"
Jul 16 12:51:12.224906 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:12.224879    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rht72"
Jul 16 12:51:12.273630 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:12.273593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2" event={"ID":"fb816cf6-da84-4bb5-bee7-a697e84ed531","Type":"ContainerStarted","Data":"99898296fdfac6a84f85adf0a98c0f93374e73795fc877e03183a7991f317585"}
Jul 16 12:51:14.890838 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:14.890803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:14.991598 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:14.991564    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:35.103769 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:35.103720    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 12:51:35.104019 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:35.103816    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 12:51:35.373807 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:35.373714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2" event={"ID":"fb816cf6-da84-4bb5-bee7-a697e84ed531","Type":"ContainerStarted","Data":"aa4165253121ce621b36068c9f02d3e1a5ed2a5bd6a07ee0ff8f78d45f2f20f5"}
Jul 16 12:51:35.373807 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:35.373802    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:35.407889 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:35.407838    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2" podStartSLOduration=2.5842054770000003 podStartE2EDuration="26.407820722s" totalImagesPullingTime="23.823615245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:51:35.405893314 +0000 UTC m=+379.144883094" watchObservedRunningTime="2026-07-16 12:51:35.407820722 +0000 UTC m=+379.146810501"
Jul 16 12:51:35.812282 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:35.812196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:35.924599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:35.924567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:36.128369 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:36.128322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:36.238778 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:36.238740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:36.379692 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:36.379616    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bkwr2"
Jul 16 12:51:36.525264 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:36.525224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:42.275837 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:42.275806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sz4th"
Jul 16 12:51:42.278872 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:42.278855    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rs4d"
Jul 16 12:51:56.756313 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:56.756225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:56.988042 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:56.988004    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:57.132919 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:57.132887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:57.630966 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:57.630932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:57.839898 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:51:57.839864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:04.672869 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:04.672834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:04.772141 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:04.772094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:14.837856 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:14.837816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:14.941477 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:14.941436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:15.044563 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:15.044530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:23.498269 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:23.498234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:27.283024 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:27.282986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:30.134391 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:30.134351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:30.569610 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:30.569516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:31.750799 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:31.750764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:34.311214 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.311177    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"]
Jul 16 12:52:34.314562 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.314546    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.317742 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.317724    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 12:52:34.318538 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.318520    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fh5x6\""
Jul 16 12:52:34.318703 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.318688    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 12:52:34.329707 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.329682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c9e6f3-996f-4477-b23d-68f37342cad4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.329822 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.329712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfzgm\" (UniqueName: \"kubernetes.io/projected/90c9e6f3-996f-4477-b23d-68f37342cad4-kube-api-access-hfzgm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.331476 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.331453    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"]
Jul 16 12:52:34.430329 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.430292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c9e6f3-996f-4477-b23d-68f37342cad4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.430329 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.430328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfzgm\" (UniqueName: \"kubernetes.io/projected/90c9e6f3-996f-4477-b23d-68f37342cad4-kube-api-access-hfzgm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.430728 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.430702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c9e6f3-996f-4477-b23d-68f37342cad4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.444968 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.444937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfzgm\" (UniqueName: \"kubernetes.io/projected/90c9e6f3-996f-4477-b23d-68f37342cad4-kube-api-access-hfzgm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.623738 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.623711    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:34.694720 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.694658    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:34.776122 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:34.776082    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"]
Jul 16 12:52:34.778641 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:52:34.778612    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c9e6f3_996f_4477_b23d_68f37342cad4.slice/crio-fa95977e5d395b1f73f2696e0bfae8c867a54d506509ffbbe0826976a5a53881 WatchSource:0}: Error finding container fa95977e5d395b1f73f2696e0bfae8c867a54d506509ffbbe0826976a5a53881: Status 404 returned error can't find the container with id fa95977e5d395b1f73f2696e0bfae8c867a54d506509ffbbe0826976a5a53881
Jul 16 12:52:35.279939 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:35.279900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:35.625320 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:35.625291    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6" event={"ID":"90c9e6f3-996f-4477-b23d-68f37342cad4","Type":"ContainerStarted","Data":"fa95977e5d395b1f73f2696e0bfae8c867a54d506509ffbbe0826976a5a53881"}
Jul 16 12:52:36.382814 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:36.382778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:39.126801 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:39.126668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:41.021198 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:41.021164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:41.118518 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:41.118489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:41.657669 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:41.657636    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6" event={"ID":"90c9e6f3-996f-4477-b23d-68f37342cad4","Type":"ContainerStarted","Data":"cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae"}
Jul 16 12:52:41.657849 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:41.657734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:41.687782 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:41.687727    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6" podStartSLOduration=1.480360646 podStartE2EDuration="7.687709399s" totalImagesPullingTime="6.207348753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:52:41.685764785 +0000 UTC m=+445.424754595" watchObservedRunningTime="2026-07-16 12:52:41.687709399 +0000 UTC m=+445.426699179"
Jul 16 12:52:43.495419 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:43.495382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:43.594331 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:43.594299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:43.865190 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:43.865140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:44.807732 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:44.807697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:47.309286 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:47.309250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:47.384337 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:47.384305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:52.665002 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:52.664975    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:54.624897 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.624865    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"]
Jul 16 12:52:54.625518 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.625095    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6" podUID="90c9e6f3-996f-4477-b23d-68f37342cad4" containerName="manager" containerID="cri-o://cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae" gracePeriod=2
Jul 16 12:52:54.634386 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.634358    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"]
Jul 16 12:52:54.637395 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:52:54.637357    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"90c9e6f3-996f-4477-b23d-68f37342cad4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:54.657187 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.657135    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"]
Jul 16 12:52:54.657511 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.657497    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c9e6f3-996f-4477-b23d-68f37342cad4" containerName="manager"
Jul 16 12:52:54.657549 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.657513    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c9e6f3-996f-4477-b23d-68f37342cad4" containerName="manager"
Jul 16 12:52:54.657585 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.657573    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c9e6f3-996f-4477-b23d-68f37342cad4" containerName="manager"
Jul 16 12:52:54.660509 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.660487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:54.662832 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:52:54.662794    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qwrw6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="90c9e6f3-996f-4477-b23d-68f37342cad4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:54.675413 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.675387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"]
Jul 16 12:52:54.815689 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.815654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-kube-api-access-5l4k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kk8xc\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:54.815833 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.815710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kk8xc\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:54.867420 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.867396    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:54.917148 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.917047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-kube-api-access-5l4k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kk8xc\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:54.917148 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.917096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kk8xc\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:54.917461 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.917444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kk8xc\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:54.929145 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.929122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-kube-api-access-5l4k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kk8xc\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:54.999398 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:54.999353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:55.018475 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.018449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c9e6f3-996f-4477-b23d-68f37342cad4-extensions-socket-volume\") pod \"90c9e6f3-996f-4477-b23d-68f37342cad4\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") "
Jul 16 12:52:55.018605 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.018484    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfzgm\" (UniqueName: \"kubernetes.io/projected/90c9e6f3-996f-4477-b23d-68f37342cad4-kube-api-access-hfzgm\") pod \"90c9e6f3-996f-4477-b23d-68f37342cad4\" (UID: \"90c9e6f3-996f-4477-b23d-68f37342cad4\") "
Jul 16 12:52:55.018976 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.018948    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c9e6f3-996f-4477-b23d-68f37342cad4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "90c9e6f3-996f-4477-b23d-68f37342cad4" (UID: "90c9e6f3-996f-4477-b23d-68f37342cad4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:52:55.021143 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.021095    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c9e6f3-996f-4477-b23d-68f37342cad4-kube-api-access-hfzgm" (OuterVolumeSpecName: "kube-api-access-hfzgm") pod "90c9e6f3-996f-4477-b23d-68f37342cad4" (UID: "90c9e6f3-996f-4477-b23d-68f37342cad4"). InnerVolumeSpecName "kube-api-access-hfzgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:52:55.119189 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.119157    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c9e6f3-996f-4477-b23d-68f37342cad4-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:52:55.119189 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.119190    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfzgm\" (UniqueName: \"kubernetes.io/projected/90c9e6f3-996f-4477-b23d-68f37342cad4-kube-api-access-hfzgm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:52:55.135359 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.135301    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"]
Jul 16 12:52:55.137755 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:52:55.137732    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3755c5fe_3c80_40c3_b6ce_529f73e3ac96.slice/crio-724e7690d43b8d4841ca29cb3d9efd0440863b7a0d10c0104b54e188ba094627 WatchSource:0}: Error finding container 724e7690d43b8d4841ca29cb3d9efd0440863b7a0d10c0104b54e188ba094627: Status 404 returned error can't find the container with id 724e7690d43b8d4841ca29cb3d9efd0440863b7a0d10c0104b54e188ba094627
Jul 16 12:52:55.721938 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.721901    2564 generic.go:356] "Generic (PLEG): container finished" podID="90c9e6f3-996f-4477-b23d-68f37342cad4" containerID="cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae" exitCode=0
Jul 16 12:52:55.722387 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.721949    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qwrw6"
Jul 16 12:52:55.722387 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.722002    2564 scope.go:117] "RemoveContainer" containerID="cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae"
Jul 16 12:52:55.724514 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.724334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc" event={"ID":"3755c5fe-3c80-40c3-b6ce-529f73e3ac96","Type":"ContainerStarted","Data":"8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2"}
Jul 16 12:52:55.724514 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.724384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc" event={"ID":"3755c5fe-3c80-40c3-b6ce-529f73e3ac96","Type":"ContainerStarted","Data":"724e7690d43b8d4841ca29cb3d9efd0440863b7a0d10c0104b54e188ba094627"}
Jul 16 12:52:55.724514 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.724465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:52:55.731186 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.731167    2564 scope.go:117] "RemoveContainer" containerID="cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae"
Jul 16 12:52:55.731428 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:52:55.731413    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae\": container with ID starting with cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae not found: ID does not exist" containerID="cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae"
Jul 16 12:52:55.731483 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.731436    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae"} err="failed to get container status \"cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae\": rpc error: code = NotFound desc = could not find container \"cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae\": container with ID starting with cd6a6f7cf0d42be6e5932314246b3d66babb15b2991bef20ca3b39a438294fae not found: ID does not exist"
Jul 16 12:52:55.757247 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:55.757198    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc" podStartSLOduration=1.7571827359999999 podStartE2EDuration="1.757182736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:52:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:52:55.756462591 +0000 UTC m=+459.495452369" watchObservedRunningTime="2026-07-16 12:52:55.757182736 +0000 UTC m=+459.496172559"
Jul 16 12:52:56.133436 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:56.133400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:56.233182 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:56.233145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:56.833382 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:56.833355    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c9e6f3-996f-4477-b23d-68f37342cad4" path="/var/lib/kubelet/pods/90c9e6f3-996f-4477-b23d-68f37342cad4/volumes"
Jul 16 12:52:58.645010 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:58.644971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:58.826559 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:52:58.826521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:01.495684 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:01.495640    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:01.602276 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:01.602240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:05.067879 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:05.067842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:05.172801 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:05.172765    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:06.732537 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:06.732508    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:53:13.896400 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:13.896359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:13.992724 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:13.992685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:16.531554 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:16.531527    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:16.658658 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:16.658616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:17.319268 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:17.319227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:17.451679 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:17.451641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:19.825664 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:19.825622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:19.941516 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:19.941483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:23.371051 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:23.371016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:23.546913 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:23.546876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:25.202155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.202100    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"]
Jul 16 12:53:25.202543 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.202327    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc" podUID="3755c5fe-3c80-40c3-b6ce-529f73e3ac96" containerName="manager" containerID="cri-o://8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2" gracePeriod=10
Jul 16 12:53:25.448673 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.448645    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:53:25.460225 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.460166    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-extensions-socket-volume\") pod \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") "
Jul 16 12:53:25.460225 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.460218    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-kube-api-access-5l4k9\") pod \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\" (UID: \"3755c5fe-3c80-40c3-b6ce-529f73e3ac96\") "
Jul 16 12:53:25.460545 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.460522    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3755c5fe-3c80-40c3-b6ce-529f73e3ac96" (UID: "3755c5fe-3c80-40c3-b6ce-529f73e3ac96"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:53:25.462299 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.462279    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-kube-api-access-5l4k9" (OuterVolumeSpecName: "kube-api-access-5l4k9") pod "3755c5fe-3c80-40c3-b6ce-529f73e3ac96" (UID: "3755c5fe-3c80-40c3-b6ce-529f73e3ac96"). InnerVolumeSpecName "kube-api-access-5l4k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:53:25.561632 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.561596    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:53:25.561632 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.561625    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l4k9\" (UniqueName: \"kubernetes.io/projected/3755c5fe-3c80-40c3-b6ce-529f73e3ac96-kube-api-access-5l4k9\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:53:25.587236 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.587204    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"]
Jul 16 12:53:25.587542 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.587531    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3755c5fe-3c80-40c3-b6ce-529f73e3ac96" containerName="manager"
Jul 16 12:53:25.587590 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.587544    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3755c5fe-3c80-40c3-b6ce-529f73e3ac96" containerName="manager"
Jul 16 12:53:25.587590 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.587589    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3755c5fe-3c80-40c3-b6ce-529f73e3ac96" containerName="manager"
Jul 16 12:53:25.590254 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.590234    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.615287 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.615260    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"]
Jul 16 12:53:25.662170 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.662135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/783e7863-bebe-42ab-835f-c467e3735177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-75d2z\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.662330 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.662236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wxbx\" (UniqueName: \"kubernetes.io/projected/783e7863-bebe-42ab-835f-c467e3735177-kube-api-access-5wxbx\") pod \"kuadrant-operator-controller-manager-86878c769f-75d2z\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.763696 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.763613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wxbx\" (UniqueName: \"kubernetes.io/projected/783e7863-bebe-42ab-835f-c467e3735177-kube-api-access-5wxbx\") pod \"kuadrant-operator-controller-manager-86878c769f-75d2z\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.763696 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.763663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/783e7863-bebe-42ab-835f-c467e3735177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-75d2z\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.764018 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.764000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/783e7863-bebe-42ab-835f-c467e3735177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-75d2z\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.777318 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.777294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wxbx\" (UniqueName: \"kubernetes.io/projected/783e7863-bebe-42ab-835f-c467e3735177-kube-api-access-5wxbx\") pod \"kuadrant-operator-controller-manager-86878c769f-75d2z\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.851996 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.851955    2564 generic.go:356] "Generic (PLEG): container finished" podID="3755c5fe-3c80-40c3-b6ce-529f73e3ac96" containerID="8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2" exitCode=0
Jul 16 12:53:25.852181 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.852012    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"
Jul 16 12:53:25.852181 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.852011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc" event={"ID":"3755c5fe-3c80-40c3-b6ce-529f73e3ac96","Type":"ContainerDied","Data":"8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2"}
Jul 16 12:53:25.852181 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.852147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc" event={"ID":"3755c5fe-3c80-40c3-b6ce-529f73e3ac96","Type":"ContainerDied","Data":"724e7690d43b8d4841ca29cb3d9efd0440863b7a0d10c0104b54e188ba094627"}
Jul 16 12:53:25.852181 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.852171    2564 scope.go:117] "RemoveContainer" containerID="8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2"
Jul 16 12:53:25.861120 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.861092    2564 scope.go:117] "RemoveContainer" containerID="8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2"
Jul 16 12:53:25.861374 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:53:25.861353    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2\": container with ID starting with 8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2 not found: ID does not exist" containerID="8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2"
Jul 16 12:53:25.861453 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.861384    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2"} err="failed to get container status \"8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2\": rpc error: code = NotFound desc = could not find container \"8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2\": container with ID starting with 8981bdcf9cc9c05059db1a7974941309c59e1ef1ba8eab4ec2e6cbd78ca86bf2 not found: ID does not exist"
Jul 16 12:53:25.894823 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.894800    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"]
Jul 16 12:53:25.900194 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.900173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:25.902930 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:25.902908    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kk8xc"]
Jul 16 12:53:26.051293 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:26.051221    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"]
Jul 16 12:53:26.054419 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:53:26.054395    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783e7863_bebe_42ab_835f_c467e3735177.slice/crio-730e803b9c20b4bbc99cb936dc613df3474de3fe580354b4d99cafa8bc3fff8b WatchSource:0}: Error finding container 730e803b9c20b4bbc99cb936dc613df3474de3fe580354b4d99cafa8bc3fff8b: Status 404 returned error can't find the container with id 730e803b9c20b4bbc99cb936dc613df3474de3fe580354b4d99cafa8bc3fff8b
Jul 16 12:53:26.833527 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:26.833495    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3755c5fe-3c80-40c3-b6ce-529f73e3ac96" path="/var/lib/kubelet/pods/3755c5fe-3c80-40c3-b6ce-529f73e3ac96/volumes"
Jul 16 12:53:26.858265 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:26.858232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z" event={"ID":"783e7863-bebe-42ab-835f-c467e3735177","Type":"ContainerStarted","Data":"ea37dbcb07ebc0f7965df6bc550570a6c0308de092f90460f1069f3d35735323"}
Jul 16 12:53:26.858520 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:26.858282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z" event={"ID":"783e7863-bebe-42ab-835f-c467e3735177","Type":"ContainerStarted","Data":"730e803b9c20b4bbc99cb936dc613df3474de3fe580354b4d99cafa8bc3fff8b"}
Jul 16 12:53:26.858520 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:26.858349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:26.892241 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:26.892189    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z" podStartSLOduration=1.89217568 podStartE2EDuration="1.89217568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:53:26.889374398 +0000 UTC m=+490.628364178" watchObservedRunningTime="2026-07-16 12:53:26.89217568 +0000 UTC m=+490.631165458"
Jul 16 12:53:32.042670 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:32.042638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:32.187886 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:32.187848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:32.388238 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:32.388202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:37.864905 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:37.864873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 12:53:41.786075 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:41.786043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:42.452438 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:42.452401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:44.295189 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.295147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:44.296325 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.296300    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"]
Jul 16 12:53:44.299528 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.299510    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.302714 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.302689    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-97zh8\""
Jul 16 12:53:44.303029 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.303013    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 12:53:44.311208 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.311187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"]
Jul 16 12:53:44.383177 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.383146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"]
Jul 16 12:53:44.411885 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.411854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:44.413930 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.413898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c854fb-f560-4ac4-9633-6b139c5809bb-config-file\") pod \"limitador-limitador-64c94fd64f-v8bhx\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.414051 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.413966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kn96\" (UniqueName: \"kubernetes.io/projected/59c854fb-f560-4ac4-9633-6b139c5809bb-kube-api-access-4kn96\") pod \"limitador-limitador-64c94fd64f-v8bhx\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.513771 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.513737    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:44.514749 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.514726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c854fb-f560-4ac4-9633-6b139c5809bb-config-file\") pod \"limitador-limitador-64c94fd64f-v8bhx\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.514858 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.514772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kn96\" (UniqueName: \"kubernetes.io/projected/59c854fb-f560-4ac4-9633-6b139c5809bb-kube-api-access-4kn96\") pod \"limitador-limitador-64c94fd64f-v8bhx\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.515346 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.515329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c854fb-f560-4ac4-9633-6b139c5809bb-config-file\") pod \"limitador-limitador-64c94fd64f-v8bhx\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.524547 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.524523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kn96\" (UniqueName: \"kubernetes.io/projected/59c854fb-f560-4ac4-9633-6b139c5809bb-kube-api-access-4kn96\") pod \"limitador-limitador-64c94fd64f-v8bhx\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.609881 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.609848    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:44.747900 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.747868    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"]
Jul 16 12:53:44.751233 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:53:44.751207    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c854fb_f560_4ac4_9633_6b139c5809bb.slice/crio-d5c1277d1bdd7fa326ca1312f579fe12fc7476956b11ef11631fc852e10fd60f WatchSource:0}: Error finding container d5c1277d1bdd7fa326ca1312f579fe12fc7476956b11ef11631fc852e10fd60f: Status 404 returned error can't find the container with id d5c1277d1bdd7fa326ca1312f579fe12fc7476956b11ef11631fc852e10fd60f
Jul 16 12:53:44.933670 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:44.933585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx" event={"ID":"59c854fb-f560-4ac4-9633-6b139c5809bb","Type":"ContainerStarted","Data":"d5c1277d1bdd7fa326ca1312f579fe12fc7476956b11ef11631fc852e10fd60f"}
Jul 16 12:53:45.330063 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:45.329984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:45.500283 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:45.500251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:47.948688 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:47.948654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx" event={"ID":"59c854fb-f560-4ac4-9633-6b139c5809bb","Type":"ContainerStarted","Data":"cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09"}
Jul 16 12:53:47.949069 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:47.948765    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:53:47.974625 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:47.974580    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx" podStartSLOduration=1.193040073 podStartE2EDuration="3.97456401s" totalImagesPullingTime="2.781523937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:53:47.972758765 +0000 UTC m=+511.711748543" watchObservedRunningTime="2026-07-16 12:53:47.97456401 +0000 UTC m=+511.713553790"
Jul 16 12:53:58.954679 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:53:58.954651    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:54:01.341263 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:01.341223    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"]
Jul 16 12:54:01.341733 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:01.341432    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx" podUID="59c854fb-f560-4ac4-9633-6b139c5809bb" containerName="limitador" containerID="cri-o://cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09" gracePeriod=30
Jul 16 12:54:01.902329 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:01.902275    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:54:02.008392 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.008356    2564 generic.go:356] "Generic (PLEG): container finished" podID="59c854fb-f560-4ac4-9633-6b139c5809bb" containerID="cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09" exitCode=0
Jul 16 12:54:02.008392 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.008396    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"
Jul 16 12:54:02.008591 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.008398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx" event={"ID":"59c854fb-f560-4ac4-9633-6b139c5809bb","Type":"ContainerDied","Data":"cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09"}
Jul 16 12:54:02.008591 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.008451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v8bhx" event={"ID":"59c854fb-f560-4ac4-9633-6b139c5809bb","Type":"ContainerDied","Data":"d5c1277d1bdd7fa326ca1312f579fe12fc7476956b11ef11631fc852e10fd60f"}
Jul 16 12:54:02.008591 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.008481    2564 scope.go:117] "RemoveContainer" containerID="cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09"
Jul 16 12:54:02.016104 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.016086    2564 scope.go:117] "RemoveContainer" containerID="cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09"
Jul 16 12:54:02.016415 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:54:02.016389    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09\": container with ID starting with cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09 not found: ID does not exist" containerID="cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09"
Jul 16 12:54:02.016470 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.016424    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09"} err="failed to get container status \"cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09\": rpc error: code = NotFound desc = could not find container \"cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09\": container with ID starting with cb47a07d2fbcf9d4996917f94d86bcb5869920922dc799dcec9f5587fc931d09 not found: ID does not exist"
Jul 16 12:54:02.062545 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.062514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kn96\" (UniqueName: \"kubernetes.io/projected/59c854fb-f560-4ac4-9633-6b139c5809bb-kube-api-access-4kn96\") pod \"59c854fb-f560-4ac4-9633-6b139c5809bb\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") "
Jul 16 12:54:02.062724 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.062564    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c854fb-f560-4ac4-9633-6b139c5809bb-config-file\") pod \"59c854fb-f560-4ac4-9633-6b139c5809bb\" (UID: \"59c854fb-f560-4ac4-9633-6b139c5809bb\") "
Jul 16 12:54:02.062914 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.062888    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59c854fb-f560-4ac4-9633-6b139c5809bb-config-file" (OuterVolumeSpecName: "config-file") pod "59c854fb-f560-4ac4-9633-6b139c5809bb" (UID: "59c854fb-f560-4ac4-9633-6b139c5809bb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:54:02.064665 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.064641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c854fb-f560-4ac4-9633-6b139c5809bb-kube-api-access-4kn96" (OuterVolumeSpecName: "kube-api-access-4kn96") pod "59c854fb-f560-4ac4-9633-6b139c5809bb" (UID: "59c854fb-f560-4ac4-9633-6b139c5809bb"). InnerVolumeSpecName "kube-api-access-4kn96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:54:02.163464 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.163387    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kn96\" (UniqueName: \"kubernetes.io/projected/59c854fb-f560-4ac4-9633-6b139c5809bb-kube-api-access-4kn96\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:54:02.163464 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.163414    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c854fb-f560-4ac4-9633-6b139c5809bb-config-file\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:54:02.350893 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.350863    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"]
Jul 16 12:54:02.359607 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.359581    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v8bhx"]
Jul 16 12:54:02.837969 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:02.837937    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c854fb-f560-4ac4-9633-6b139c5809bb" path="/var/lib/kubelet/pods/59c854fb-f560-4ac4-9633-6b139c5809bb/volumes"
Jul 16 12:54:05.590630 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:05.590598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:05.686529 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:05.686497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:06.087236 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.087203    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"]
Jul 16 12:54:06.087542 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.087530    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c854fb-f560-4ac4-9633-6b139c5809bb" containerName="limitador"
Jul 16 12:54:06.087595 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.087543    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c854fb-f560-4ac4-9633-6b139c5809bb" containerName="limitador"
Jul 16 12:54:06.087632 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.087596    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c854fb-f560-4ac4-9633-6b139c5809bb" containerName="limitador"
Jul 16 12:54:06.091911 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.091895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.097157 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.097132    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 12:54:06.098271 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.097984    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 12:54:06.098271 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.098004    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5s4f7\""
Jul 16 12:54:06.098271 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.098087    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 12:54:06.106073 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.106052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"]
Jul 16 12:54:06.146155 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.146129    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:06.199351 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.199316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tsbz\" (UniqueName: \"kubernetes.io/projected/863fc512-6f9d-480d-9509-25ac800ac636-kube-api-access-7tsbz\") pod \"postgres-69fb4594cf-pmf2r\" (UID: \"863fc512-6f9d-480d-9509-25ac800ac636\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.199506 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.199385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/863fc512-6f9d-480d-9509-25ac800ac636-data\") pod \"postgres-69fb4594cf-pmf2r\" (UID: \"863fc512-6f9d-480d-9509-25ac800ac636\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.300429 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.300399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbz\" (UniqueName: \"kubernetes.io/projected/863fc512-6f9d-480d-9509-25ac800ac636-kube-api-access-7tsbz\") pod \"postgres-69fb4594cf-pmf2r\" (UID: \"863fc512-6f9d-480d-9509-25ac800ac636\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.300590 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.300454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/863fc512-6f9d-480d-9509-25ac800ac636-data\") pod \"postgres-69fb4594cf-pmf2r\" (UID: \"863fc512-6f9d-480d-9509-25ac800ac636\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.300762 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.300748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/863fc512-6f9d-480d-9509-25ac800ac636-data\") pod \"postgres-69fb4594cf-pmf2r\" (UID: \"863fc512-6f9d-480d-9509-25ac800ac636\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.314206 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.314174    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tsbz\" (UniqueName: \"kubernetes.io/projected/863fc512-6f9d-480d-9509-25ac800ac636-kube-api-access-7tsbz\") pod \"postgres-69fb4594cf-pmf2r\" (UID: \"863fc512-6f9d-480d-9509-25ac800ac636\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.401533 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.401450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:06.537797 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:06.537764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"]
Jul 16 12:54:06.540103 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:54:06.540077    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863fc512_6f9d_480d_9509_25ac800ac636.slice/crio-742143b45176b201c50a6361403b18a2969f32f26b3c2bb5b2f41ae4fec2a0f2 WatchSource:0}: Error finding container 742143b45176b201c50a6361403b18a2969f32f26b3c2bb5b2f41ae4fec2a0f2: Status 404 returned error can't find the container with id 742143b45176b201c50a6361403b18a2969f32f26b3c2bb5b2f41ae4fec2a0f2
Jul 16 12:54:07.030357 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:07.030324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r" event={"ID":"863fc512-6f9d-480d-9509-25ac800ac636","Type":"ContainerStarted","Data":"742143b45176b201c50a6361403b18a2969f32f26b3c2bb5b2f41ae4fec2a0f2"}
Jul 16 12:54:12.059130 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:12.059078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r" event={"ID":"863fc512-6f9d-480d-9509-25ac800ac636","Type":"ContainerStarted","Data":"b72f4a2639876f9cd40b423f78a1fbff39aecf501a2e39e28334758fd1357536"}
Jul 16 12:54:12.059532 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:12.059187    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:12.080776 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:12.080729    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r" podStartSLOduration=1.3085920930000001 podStartE2EDuration="6.080714427s" totalImagesPullingTime="4.772122334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:54:12.079532077 +0000 UTC m=+535.818521857" watchObservedRunningTime="2026-07-16 12:54:12.080714427 +0000 UTC m=+535.819704209"
Jul 16 12:54:17.405065 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:17.405026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:18.093027 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:18.093000    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pmf2r"
Jul 16 12:54:18.497018 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:18.496927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:18.970444 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:18.970405    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:20.359654 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:20.359618    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:20.451807 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:20.451774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:22.514248 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:22.514207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:26.634632 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.634593    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55c848ff87-gldlj"]
Jul 16 12:54:26.643498 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.643467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:26.657430 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.657403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55c848ff87-gldlj"]
Jul 16 12:54:26.657581 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.657504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.660365 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.660337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 12:54:26.660365 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.660359    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 12:54:26.660576 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.660410    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fms59\""
Jul 16 12:54:26.726378 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.726316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:26.775021 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.774989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-webhook-cert\") pod \"maas-controller-55c848ff87-gldlj\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") " pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.775174 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.775044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvpbm\" (UniqueName: \"kubernetes.io/projected/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-kube-api-access-vvpbm\") pod \"maas-controller-55c848ff87-gldlj\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") " pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.809856 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.809827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:26.845846 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.845818    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-2v47d"]
Jul 16 12:54:26.849076 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.849057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:26.863742 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.863720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-2v47d"]
Jul 16 12:54:26.875487 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.875451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-webhook-cert\") pod \"maas-controller-55c848ff87-gldlj\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") " pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.875617 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.875538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvpbm\" (UniqueName: \"kubernetes.io/projected/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-kube-api-access-vvpbm\") pod \"maas-controller-55c848ff87-gldlj\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") " pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.878331 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.878300    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-webhook-cert\") pod \"maas-controller-55c848ff87-gldlj\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") " pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.883621 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.883596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:26.885417 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.885368    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvpbm\" (UniqueName: \"kubernetes.io/projected/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-kube-api-access-vvpbm\") pod \"maas-controller-55c848ff87-gldlj\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") " pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.968325 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.968293    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:26.976467 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.976446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7f49c91-b72e-40a9-8b1a-937ac5405d70-webhook-cert\") pod \"maas-controller-55f9cb4fbd-2v47d\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") " pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:26.976565 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:26.976530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8d2\" (UniqueName: \"kubernetes.io/projected/a7f49c91-b72e-40a9-8b1a-937ac5405d70-kube-api-access-kd8d2\") pod \"maas-controller-55f9cb4fbd-2v47d\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") " pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:27.077636 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.077588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7f49c91-b72e-40a9-8b1a-937ac5405d70-webhook-cert\") pod \"maas-controller-55f9cb4fbd-2v47d\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") " pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:27.077827 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.077680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8d2\" (UniqueName: \"kubernetes.io/projected/a7f49c91-b72e-40a9-8b1a-937ac5405d70-kube-api-access-kd8d2\") pod \"maas-controller-55f9cb4fbd-2v47d\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") " pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:27.080528 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.080499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7f49c91-b72e-40a9-8b1a-937ac5405d70-webhook-cert\") pod \"maas-controller-55f9cb4fbd-2v47d\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") " pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:27.090508 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.090485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8d2\" (UniqueName: \"kubernetes.io/projected/a7f49c91-b72e-40a9-8b1a-937ac5405d70-kube-api-access-kd8d2\") pod \"maas-controller-55f9cb4fbd-2v47d\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") " pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:27.105749 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.105727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55c848ff87-gldlj"]
Jul 16 12:54:27.108093 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:54:27.108064    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8033fc75_5c8d_4f38_a5b3_8a15a8265c8a.slice/crio-abc8d86c06b6410efa56584d857369782281b4ab7ed6774c88fb456a614f2d7f WatchSource:0}: Error finding container abc8d86c06b6410efa56584d857369782281b4ab7ed6774c88fb456a614f2d7f: Status 404 returned error can't find the container with id abc8d86c06b6410efa56584d857369782281b4ab7ed6774c88fb456a614f2d7f
Jul 16 12:54:27.126019 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.125992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c848ff87-gldlj" event={"ID":"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a","Type":"ContainerStarted","Data":"abc8d86c06b6410efa56584d857369782281b4ab7ed6774c88fb456a614f2d7f"}
Jul 16 12:54:27.159136 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.159048    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:27.306934 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:27.306910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-2v47d"]
Jul 16 12:54:27.309270 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:54:27.309240    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f49c91_b72e_40a9_8b1a_937ac5405d70.slice/crio-8cd6972b501151ebd7e4e4d35357fbf925079156fd41066cd3c35486a401decf WatchSource:0}: Error finding container 8cd6972b501151ebd7e4e4d35357fbf925079156fd41066cd3c35486a401decf: Status 404 returned error can't find the container with id 8cd6972b501151ebd7e4e4d35357fbf925079156fd41066cd3c35486a401decf
Jul 16 12:54:28.130783 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:28.130746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d" event={"ID":"a7f49c91-b72e-40a9-8b1a-937ac5405d70","Type":"ContainerStarted","Data":"8cd6972b501151ebd7e4e4d35357fbf925079156fd41066cd3c35486a401decf"}
Jul 16 12:54:30.771424 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:30.771335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:30.979472 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:30.979438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:31.147500 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:31.147462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c848ff87-gldlj" event={"ID":"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a","Type":"ContainerStarted","Data":"b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2"}
Jul 16 12:54:31.147696 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:31.147615    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:31.148944 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:31.148918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d" event={"ID":"a7f49c91-b72e-40a9-8b1a-937ac5405d70","Type":"ContainerStarted","Data":"f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6"}
Jul 16 12:54:31.149047 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:31.148975    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:31.175894 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:31.175851    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55c848ff87-gldlj" podStartSLOduration=1.826958211 podStartE2EDuration="5.17583681s" totalImagesPullingTime="3.348878599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:54:31.175012977 +0000 UTC m=+554.914002754" watchObservedRunningTime="2026-07-16 12:54:31.17583681 +0000 UTC m=+554.914826587"
Jul 16 12:54:31.202275 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:31.202227    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d" podStartSLOduration=2.042650803 podStartE2EDuration="5.202212122s" totalImagesPullingTime="3.159561319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:54:31.199825128 +0000 UTC m=+554.938814905" watchObservedRunningTime="2026-07-16 12:54:31.202212122 +0000 UTC m=+554.941201899"
Jul 16 12:54:42.158922 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.158883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:42.159343 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.158970    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:54:42.239693 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.239664    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55c848ff87-gldlj"]
Jul 16 12:54:42.239894 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.239869    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55c848ff87-gldlj" podUID="8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" containerName="manager" containerID="cri-o://b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2" gracePeriod=30
Jul 16 12:54:42.492309 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.492285    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:42.615085 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.615056    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-webhook-cert\") pod \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") "
Jul 16 12:54:42.615292 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.615097    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvpbm\" (UniqueName: \"kubernetes.io/projected/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-kube-api-access-vvpbm\") pod \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\" (UID: \"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a\") "
Jul 16 12:54:42.617317 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.617291    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" (UID: "8033fc75-5c8d-4f38-a5b3-8a15a8265c8a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:54:42.617414 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.617358    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-kube-api-access-vvpbm" (OuterVolumeSpecName: "kube-api-access-vvpbm") pod "8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" (UID: "8033fc75-5c8d-4f38-a5b3-8a15a8265c8a"). InnerVolumeSpecName "kube-api-access-vvpbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:54:42.715909 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.715832    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-webhook-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:54:42.715909 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:42.715860    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvpbm\" (UniqueName: \"kubernetes.io/projected/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a-kube-api-access-vvpbm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:54:43.204816 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.204780    2564 generic.go:356] "Generic (PLEG): container finished" podID="8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" containerID="b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2" exitCode=0
Jul 16 12:54:43.205227 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.204827    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c848ff87-gldlj"
Jul 16 12:54:43.205227 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.204860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c848ff87-gldlj" event={"ID":"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a","Type":"ContainerDied","Data":"b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2"}
Jul 16 12:54:43.205227 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.204911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c848ff87-gldlj" event={"ID":"8033fc75-5c8d-4f38-a5b3-8a15a8265c8a","Type":"ContainerDied","Data":"abc8d86c06b6410efa56584d857369782281b4ab7ed6774c88fb456a614f2d7f"}
Jul 16 12:54:43.205227 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.204933    2564 scope.go:117] "RemoveContainer" containerID="b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2"
Jul 16 12:54:43.212639 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.212618    2564 scope.go:117] "RemoveContainer" containerID="b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2"
Jul 16 12:54:43.212895 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:54:43.212878    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2\": container with ID starting with b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2 not found: ID does not exist" containerID="b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2"
Jul 16 12:54:43.212938 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.212904    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2"} err="failed to get container status \"b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2\": rpc error: code = NotFound desc = could not find container \"b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2\": container with ID starting with b6726b5521cb6aa3fe0cc088758290e6efa178f0b35c56f959c8a62bbd1ce6b2 not found: ID does not exist"
Jul 16 12:54:43.229974 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.229949    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55c848ff87-gldlj"]
Jul 16 12:54:43.235449 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:43.235427    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55c848ff87-gldlj"]
Jul 16 12:54:44.833343 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:54:44.833312    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" path="/var/lib/kubelet/pods/8033fc75-5c8d-4f38-a5b3-8a15a8265c8a/volumes"
Jul 16 12:55:04.000751 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.000705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:04.150410 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.150372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:04.748942 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.748909    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-794579b75-9hdcd"]
Jul 16 12:55:04.749286 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.749272    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" containerName="manager"
Jul 16 12:55:04.749348 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.749289    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" containerName="manager"
Jul 16 12:55:04.749394 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.749357    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8033fc75-5c8d-4f38-a5b3-8a15a8265c8a" containerName="manager"
Jul 16 12:55:04.753804 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.753786    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.761330 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.761304    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 12:55:04.761453 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.761307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-58cpz\""
Jul 16 12:55:04.772263 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.772234    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-794579b75-9hdcd"]
Jul 16 12:55:04.798407 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.798373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jzkc\" (UniqueName: \"kubernetes.io/projected/4a2bb59f-4c01-4b98-8509-a410fb6e9573-kube-api-access-7jzkc\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.798553 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.798442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a2bb59f-4c01-4b98-8509-a410fb6e9573-openshift-service-ca\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.798553 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.798480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a2bb59f-4c01-4b98-8509-a410fb6e9573-maas-api-tls\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.874971 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.874939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:04.898918 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.898890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a2bb59f-4c01-4b98-8509-a410fb6e9573-maas-api-tls\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.899056 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.898974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jzkc\" (UniqueName: \"kubernetes.io/projected/4a2bb59f-4c01-4b98-8509-a410fb6e9573-kube-api-access-7jzkc\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.899056 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.899036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a2bb59f-4c01-4b98-8509-a410fb6e9573-openshift-service-ca\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.899635 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.899611    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a2bb59f-4c01-4b98-8509-a410fb6e9573-openshift-service-ca\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.901295 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.901279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a2bb59f-4c01-4b98-8509-a410fb6e9573-maas-api-tls\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.910131 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.910081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jzkc\" (UniqueName: \"kubernetes.io/projected/4a2bb59f-4c01-4b98-8509-a410fb6e9573-kube-api-access-7jzkc\") pod \"maas-api-794579b75-9hdcd\" (UID: \"4a2bb59f-4c01-4b98-8509-a410fb6e9573\") " pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:04.977117 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:04.977087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:05.063816 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.063732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:05.203067 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.203043    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-794579b75-9hdcd"]
Jul 16 12:55:05.205171 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:55:05.205144    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2bb59f_4c01_4b98_8509_a410fb6e9573.slice/crio-bf25f7aeb292c97516268226ba32be9f93d2ae81e811c6eaf3dac2a2bb2bca4d WatchSource:0}: Error finding container bf25f7aeb292c97516268226ba32be9f93d2ae81e811c6eaf3dac2a2bb2bca4d: Status 404 returned error can't find the container with id bf25f7aeb292c97516268226ba32be9f93d2ae81e811c6eaf3dac2a2bb2bca4d
Jul 16 12:55:05.300343 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.300311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd" event={"ID":"4a2bb59f-4c01-4b98-8509-a410fb6e9573","Type":"ContainerStarted","Data":"bf25f7aeb292c97516268226ba32be9f93d2ae81e811c6eaf3dac2a2bb2bca4d"}
Jul 16 12:55:05.371586 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.371549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:05.469492 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.469461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:05.509323 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.509286    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"]
Jul 16 12:55:05.512173 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.512154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.514645 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.514628    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 12:55:05.514762 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.514732    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v4jvg\""
Jul 16 12:55:05.523562 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.523540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"]
Jul 16 12:55:05.562026 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.561994    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"]
Jul 16 12:55:05.564057 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.564041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.582782 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.582754    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"]
Jul 16 12:55:05.604467 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.604436    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5jbq\" (UniqueName: \"kubernetes.io/projected/d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a-kube-api-access-s5jbq\") pod \"payload-pre-processing-74584bb9f8-f5qdm\" (UID: \"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.604631 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.604483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29c6\" (UniqueName: \"kubernetes.io/projected/5d83a672-e6c7-4562-a0f7-676b7f9e0bea-kube-api-access-g29c6\") pod \"payload-processing-f9b8d9b9b-bh7dp\" (UID: \"5d83a672-e6c7-4562-a0f7-676b7f9e0bea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.604631 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.604524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-f5qdm\" (UID: \"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.604738 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.604645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d83a672-e6c7-4562-a0f7-676b7f9e0bea-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-bh7dp\" (UID: \"5d83a672-e6c7-4562-a0f7-676b7f9e0bea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.705473 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.705381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d83a672-e6c7-4562-a0f7-676b7f9e0bea-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-bh7dp\" (UID: \"5d83a672-e6c7-4562-a0f7-676b7f9e0bea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.705473 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.705437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5jbq\" (UniqueName: \"kubernetes.io/projected/d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a-kube-api-access-s5jbq\") pod \"payload-pre-processing-74584bb9f8-f5qdm\" (UID: \"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.705473 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.705468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29c6\" (UniqueName: \"kubernetes.io/projected/5d83a672-e6c7-4562-a0f7-676b7f9e0bea-kube-api-access-g29c6\") pod \"payload-processing-f9b8d9b9b-bh7dp\" (UID: \"5d83a672-e6c7-4562-a0f7-676b7f9e0bea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.705775 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.705507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-f5qdm\" (UID: \"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.706175 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.706152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d83a672-e6c7-4562-a0f7-676b7f9e0bea-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-bh7dp\" (UID: \"5d83a672-e6c7-4562-a0f7-676b7f9e0bea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.706309 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.706288    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-f5qdm\" (UID: \"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.715382 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.715358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29c6\" (UniqueName: \"kubernetes.io/projected/5d83a672-e6c7-4562-a0f7-676b7f9e0bea-kube-api-access-g29c6\") pod \"payload-processing-f9b8d9b9b-bh7dp\" (UID: \"5d83a672-e6c7-4562-a0f7-676b7f9e0bea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.715481 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.715358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5jbq\" (UniqueName: \"kubernetes.io/projected/d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a-kube-api-access-s5jbq\") pod \"payload-pre-processing-74584bb9f8-f5qdm\" (UID: \"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.823324 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.823283    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:05.874551 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.874484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:05.979542 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:05.979410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"]
Jul 16 12:55:05.982345 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:55:05.982307    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d83a672_e6c7_4562_a0f7_676b7f9e0bea.slice/crio-eea49e4164404ef088cd4fb92bd623996c5a0d175131a24a38ad1ac40538be4a WatchSource:0}: Error finding container eea49e4164404ef088cd4fb92bd623996c5a0d175131a24a38ad1ac40538be4a: Status 404 returned error can't find the container with id eea49e4164404ef088cd4fb92bd623996c5a0d175131a24a38ad1ac40538be4a
Jul 16 12:55:06.034675 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:06.034651    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"]
Jul 16 12:55:06.036315 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:55:06.036282    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e40d13_ef7b_4e5d_9d53_0bc1107ed51a.slice/crio-67af962c225f79a1573437f6715fdf777f953f471eba0c56009dacc740a2f824 WatchSource:0}: Error finding container 67af962c225f79a1573437f6715fdf777f953f471eba0c56009dacc740a2f824: Status 404 returned error can't find the container with id 67af962c225f79a1573437f6715fdf777f953f471eba0c56009dacc740a2f824
Jul 16 12:55:06.307177 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:06.307085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm" event={"ID":"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a","Type":"ContainerStarted","Data":"67af962c225f79a1573437f6715fdf777f953f471eba0c56009dacc740a2f824"}
Jul 16 12:55:06.308536 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:06.308505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp" event={"ID":"5d83a672-e6c7-4562-a0f7-676b7f9e0bea","Type":"ContainerStarted","Data":"eea49e4164404ef088cd4fb92bd623996c5a0d175131a24a38ad1ac40538be4a"}
Jul 16 12:55:07.315120 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:07.315022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd" event={"ID":"4a2bb59f-4c01-4b98-8509-a410fb6e9573","Type":"ContainerStarted","Data":"fadf52557b51644c6ce51dbdc9b07daf8d925c449f63737efd06d0719f33fdaf"}
Jul 16 12:55:07.315540 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:07.315140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:07.338948 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:07.338901    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd" podStartSLOduration=1.584345496 podStartE2EDuration="3.338885966s" totalImagesPullingTime="1.75454047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:55:07.336491457 +0000 UTC m=+591.075481273" watchObservedRunningTime="2026-07-16 12:55:07.338885966 +0000 UTC m=+591.077875763"
Jul 16 12:55:08.321335 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:08.321297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp" event={"ID":"5d83a672-e6c7-4562-a0f7-676b7f9e0bea","Type":"ContainerStarted","Data":"3b9bfc57fdf33dff3518c61577a83623a003ca8689d954ca5390cf4065e18bd7"}
Jul 16 12:55:08.321776 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:08.321415    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:08.322764 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:08.322742    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm" event={"ID":"d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a","Type":"ContainerStarted","Data":"d9ea4241537c0eee196ac67df7cfcfee1fca4105ffeda2c32f255b7fa5bc23e1"}
Jul 16 12:55:08.349016 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:08.348975    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp" podStartSLOduration=1.960094537 podStartE2EDuration="3.34895921s" totalImagesPullingTime="1.388864673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:55:08.347970646 +0000 UTC m=+592.086960426" watchObservedRunningTime="2026-07-16 12:55:08.34895921 +0000 UTC m=+592.087948989"
Jul 16 12:55:08.376243 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:08.376200    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm" podStartSLOduration=2.042839433 podStartE2EDuration="3.376186314s" totalImagesPullingTime="1.333346881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:55:08.375207705 +0000 UTC m=+592.114197484" watchObservedRunningTime="2026-07-16 12:55:08.376186314 +0000 UTC m=+592.115176092"
Jul 16 12:55:09.327789 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:09.327755    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:13.328052 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:13.328006    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-794579b75-9hdcd"
Jul 16 12:55:14.513171 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:14.513139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:15.463509 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:15.463479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:19.329217 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:19.329188    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-bh7dp"
Jul 16 12:55:20.335644 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:20.335618    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-f5qdm"
Jul 16 12:55:26.031889 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.031854    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"]
Jul 16 12:55:26.036105 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.036084    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.039011 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.038974    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 12:55:26.039011 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.038987    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 12:55:26.039207 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.039130    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nnbbp\""
Jul 16 12:55:26.040237 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.040223    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 12:55:26.068019 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.067989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"]
Jul 16 12:55:26.084093 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.084063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:26.086152 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.086089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.086261 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.086196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.086261 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.086244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.086356 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.086279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.086390 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.086369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.086422 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.086401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkns4\" (UniqueName: \"kubernetes.io/projected/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-kube-api-access-tkns4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187089 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187288 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187288 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187288 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187440 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187440 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkns4\" (UniqueName: \"kubernetes.io/projected/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-kube-api-access-tkns4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187547 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187599 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.187655 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.187637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.189665 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.189644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.189966 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.189948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.197808 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.197783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkns4\" (UniqueName: \"kubernetes.io/projected/06a7b5b7-f21f-4ca4-8a20-1573da5edbe4-kube-api-access-tkns4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq\" (UID: \"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.347918 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.347871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:26.516617 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:26.516566    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"]
Jul 16 12:55:26.519287 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:55:26.519259    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a7b5b7_f21f_4ca4_8a20_1573da5edbe4.slice/crio-45fe9176312341bc06ceaff4fce555c6faae569ab2b683f6f6219632f75d2353 WatchSource:0}: Error finding container 45fe9176312341bc06ceaff4fce555c6faae569ab2b683f6f6219632f75d2353: Status 404 returned error can't find the container with id 45fe9176312341bc06ceaff4fce555c6faae569ab2b683f6f6219632f75d2353
Jul 16 12:55:27.414487 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:27.414448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq" event={"ID":"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4","Type":"ContainerStarted","Data":"45fe9176312341bc06ceaff4fce555c6faae569ab2b683f6f6219632f75d2353"}
Jul 16 12:55:28.420509 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:28.420474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq" event={"ID":"06a7b5b7-f21f-4ca4-8a20-1573da5edbe4","Type":"ContainerStarted","Data":"b8e4f1fc4412f7cc5d70412a454d57263ffd5822c01c2f8fdfd1508d4d72ee45"}
Jul 16 12:55:28.471806 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:28.471697    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq" podStartSLOduration=1.7812714509999998 podStartE2EDuration="3.471679893s" totalImagesPullingTime="1.690408442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:55:28.470332872 +0000 UTC m=+612.209322668" watchObservedRunningTime="2026-07-16 12:55:28.471679893 +0000 UTC m=+612.210669671"
Jul 16 12:55:35.667842 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:35.667805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:36.348749 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:36.348719    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:36.348914 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:36.348811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:36.361009 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:36.360972    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:36.467984 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:36.467951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq"
Jul 16 12:55:45.230735 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:45.230626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:53.817197 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:55:53.817154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:06.365807 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:56:06.365772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:20.418217 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:56:20.418178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:31.618272 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:56:31.618232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:31.721010 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:56:31.720980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:52.053493 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:56:52.053461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:52.153479 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:56:52.153442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:57:54.732800 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:57:54.732766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:57:54.840411 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:57:54.840381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:57:55.998030 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:57:55.997980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:57:56.135128 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:57:56.135076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:28.702242 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:58:28.702196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:28.819923 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:58:28.819887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:32.306902 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:58:32.306864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:47.308870 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:58:47.308773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:08.974591 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:08.974527    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:09.077695 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.077661    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-2v47d"]
Jul 16 12:59:09.077869 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.077850    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d" podUID="a7f49c91-b72e-40a9-8b1a-937ac5405d70" containerName="manager" containerID="cri-o://f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6" gracePeriod=30
Jul 16 12:59:09.328681 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.328657    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:59:09.457748 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.457716    2564 generic.go:356] "Generic (PLEG): container finished" podID="a7f49c91-b72e-40a9-8b1a-937ac5405d70" containerID="f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6" exitCode=0
Jul 16 12:59:09.457915 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.457754    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d"
Jul 16 12:59:09.457915 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.457753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d" event={"ID":"a7f49c91-b72e-40a9-8b1a-937ac5405d70","Type":"ContainerDied","Data":"f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6"}
Jul 16 12:59:09.457915 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.457894    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f9cb4fbd-2v47d" event={"ID":"a7f49c91-b72e-40a9-8b1a-937ac5405d70","Type":"ContainerDied","Data":"8cd6972b501151ebd7e4e4d35357fbf925079156fd41066cd3c35486a401decf"}
Jul 16 12:59:09.458015 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.457928    2564 scope.go:117] "RemoveContainer" containerID="f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6"
Jul 16 12:59:09.466003 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.465982    2564 scope.go:117] "RemoveContainer" containerID="f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6"
Jul 16 12:59:09.466333 ip-10-0-131-226 kubenswrapper[2564]: E0716 12:59:09.466282    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6\": container with ID starting with f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6 not found: ID does not exist" containerID="f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6"
Jul 16 12:59:09.466410 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.466344    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6"} err="failed to get container status \"f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6\": rpc error: code = NotFound desc = could not find container \"f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6\": container with ID starting with f46b9ac8682c87f612ff79f5c9dde8a434ae3c968fcc5df37d636a7dbe2258a6 not found: ID does not exist"
Jul 16 12:59:09.475659 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.475636    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7f49c91-b72e-40a9-8b1a-937ac5405d70-webhook-cert\") pod \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") "
Jul 16 12:59:09.475840 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.475826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd8d2\" (UniqueName: \"kubernetes.io/projected/a7f49c91-b72e-40a9-8b1a-937ac5405d70-kube-api-access-kd8d2\") pod \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\" (UID: \"a7f49c91-b72e-40a9-8b1a-937ac5405d70\") "
Jul 16 12:59:09.477738 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.477714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f49c91-b72e-40a9-8b1a-937ac5405d70-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7f49c91-b72e-40a9-8b1a-937ac5405d70" (UID: "a7f49c91-b72e-40a9-8b1a-937ac5405d70"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:59:09.477738 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.477734    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f49c91-b72e-40a9-8b1a-937ac5405d70-kube-api-access-kd8d2" (OuterVolumeSpecName: "kube-api-access-kd8d2") pod "a7f49c91-b72e-40a9-8b1a-937ac5405d70" (UID: "a7f49c91-b72e-40a9-8b1a-937ac5405d70"). InnerVolumeSpecName "kube-api-access-kd8d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:59:09.576543 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.576457    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd8d2\" (UniqueName: \"kubernetes.io/projected/a7f49c91-b72e-40a9-8b1a-937ac5405d70-kube-api-access-kd8d2\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:59:09.576543 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.576486    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7f49c91-b72e-40a9-8b1a-937ac5405d70-webhook-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 12:59:09.782672 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.782640    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-2v47d"]
Jul 16 12:59:09.787264 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:09.787239    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-2v47d"]
Jul 16 12:59:10.495887 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.495856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:10.616207 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.616172    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-5g2mw"]
Jul 16 12:59:10.616523 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.616511    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f49c91-b72e-40a9-8b1a-937ac5405d70" containerName="manager"
Jul 16 12:59:10.616567 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.616525    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f49c91-b72e-40a9-8b1a-937ac5405d70" containerName="manager"
Jul 16 12:59:10.616603 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.616589    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7f49c91-b72e-40a9-8b1a-937ac5405d70" containerName="manager"
Jul 16 12:59:10.620794 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.620774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:10.627851 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.624912    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 12:59:10.627851 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.625212    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fms59\""
Jul 16 12:59:10.627851 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.625456    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 12:59:10.632263 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.632234    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-5g2mw"]
Jul 16 12:59:10.685758 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.685722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snbkt\" (UniqueName: \"kubernetes.io/projected/0b1e9814-87cf-4e33-8414-76e13ea0d6f3-kube-api-access-snbkt\") pod \"maas-controller-55f9cb4fbd-5g2mw\" (UID: \"0b1e9814-87cf-4e33-8414-76e13ea0d6f3\") " pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:10.685932 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.685786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b1e9814-87cf-4e33-8414-76e13ea0d6f3-webhook-cert\") pod \"maas-controller-55f9cb4fbd-5g2mw\" (UID: \"0b1e9814-87cf-4e33-8414-76e13ea0d6f3\") " pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:10.786591 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.786503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b1e9814-87cf-4e33-8414-76e13ea0d6f3-webhook-cert\") pod \"maas-controller-55f9cb4fbd-5g2mw\" (UID: \"0b1e9814-87cf-4e33-8414-76e13ea0d6f3\") " pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:10.786591 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.786580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snbkt\" (UniqueName: \"kubernetes.io/projected/0b1e9814-87cf-4e33-8414-76e13ea0d6f3-kube-api-access-snbkt\") pod \"maas-controller-55f9cb4fbd-5g2mw\" (UID: \"0b1e9814-87cf-4e33-8414-76e13ea0d6f3\") " pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:10.788912 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.788882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b1e9814-87cf-4e33-8414-76e13ea0d6f3-webhook-cert\") pod \"maas-controller-55f9cb4fbd-5g2mw\" (UID: \"0b1e9814-87cf-4e33-8414-76e13ea0d6f3\") " pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:10.798571 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.798549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snbkt\" (UniqueName: \"kubernetes.io/projected/0b1e9814-87cf-4e33-8414-76e13ea0d6f3-kube-api-access-snbkt\") pod \"maas-controller-55f9cb4fbd-5g2mw\" (UID: \"0b1e9814-87cf-4e33-8414-76e13ea0d6f3\") " pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:10.834610 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.834582    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f49c91-b72e-40a9-8b1a-937ac5405d70" path="/var/lib/kubelet/pods/a7f49c91-b72e-40a9-8b1a-937ac5405d70/volumes"
Jul 16 12:59:10.938596 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:10.938563    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:11.076285 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:11.076241    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f9cb4fbd-5g2mw"]
Jul 16 12:59:11.078511 ip-10-0-131-226 kubenswrapper[2564]: W0716 12:59:11.078483    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1e9814_87cf_4e33_8414_76e13ea0d6f3.slice/crio-a8fa9a43c1994fdf068ed878a0656892cf7030e38db7ade58176009ad11393b1 WatchSource:0}: Error finding container a8fa9a43c1994fdf068ed878a0656892cf7030e38db7ade58176009ad11393b1: Status 404 returned error can't find the container with id a8fa9a43c1994fdf068ed878a0656892cf7030e38db7ade58176009ad11393b1
Jul 16 12:59:11.079664 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:11.079639    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:59:11.468137 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:11.468085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw" event={"ID":"0b1e9814-87cf-4e33-8414-76e13ea0d6f3","Type":"ContainerStarted","Data":"a8fa9a43c1994fdf068ed878a0656892cf7030e38db7ade58176009ad11393b1"}
Jul 16 12:59:12.474628 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:12.474597    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw" event={"ID":"0b1e9814-87cf-4e33-8414-76e13ea0d6f3","Type":"ContainerStarted","Data":"de62730762da2e2f1eab22ac2d8be23b52467aac453e51e86c844f53ff07e477"}
Jul 16 12:59:12.475046 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:12.474659    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:12.496096 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:12.496050    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw" podStartSLOduration=2.046397099 podStartE2EDuration="2.496034914s" totalImagesPullingTime="449.637815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:59:12.494555967 +0000 UTC m=+836.233545749" watchObservedRunningTime="2026-07-16 12:59:12.496034914 +0000 UTC m=+836.235024745"
Jul 16 12:59:23.481451 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:23.481421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55f9cb4fbd-5g2mw"
Jul 16 12:59:30.787987 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:30.787946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:52.384721 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:52.384686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:52.749182 ip-10-0-131-226 kubenswrapper[2564]: I0716 12:59:52.749085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:00.191232 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.191195    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b"]
Jul 16 13:00:00.194462 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.194444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b"
Jul 16 13:00:00.199905 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.199879    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:00:00.203719 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.203697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b"
Jul 16 13:00:00.209671 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.209644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b"]
Jul 16 13:00:00.328478 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.328438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:00.366601 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.366569    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b"]
Jul 16 13:00:00.368930 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:00:00.368904    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99cf2572_ac8e_4bcf_8c00_aba0ac0f5934.slice/crio-66fa1642763ac88ef7c179272b21f6559d7f5f6dd5d46386f6c7df84f01e8ed4 WatchSource:0}: Error finding container 66fa1642763ac88ef7c179272b21f6559d7f5f6dd5d46386f6c7df84f01e8ed4: Status 404 returned error can't find the container with id 66fa1642763ac88ef7c179272b21f6559d7f5f6dd5d46386f6c7df84f01e8ed4
Jul 16 13:00:00.574422 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.574310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:00.705865 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.705824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b" event={"ID":"99cf2572-ac8e-4bcf-8c00-aba0ac0f5934","Type":"ContainerStarted","Data":"66fa1642763ac88ef7c179272b21f6559d7f5f6dd5d46386f6c7df84f01e8ed4"}
Jul 16 13:00:00.805365 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:00.805331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:06.736330 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:06.736297    2564 generic.go:356] "Generic (PLEG): container finished" podID="99cf2572-ac8e-4bcf-8c00-aba0ac0f5934" containerID="a196e3116418b26e1a23c4c78824e9bcd7eb48923265ee4cf23a974ab1403637" exitCode=0
Jul 16 13:00:06.736890 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:06.736380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b" event={"ID":"99cf2572-ac8e-4bcf-8c00-aba0ac0f5934","Type":"ContainerDied","Data":"a196e3116418b26e1a23c4c78824e9bcd7eb48923265ee4cf23a974ab1403637"}
Jul 16 13:00:07.867847 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:07.867819    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b"
Jul 16 13:00:08.328772 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:08.328683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:08.527644 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:08.527609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:08.748426 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:08.748397    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b"
Jul 16 13:00:08.748603 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:08.748397    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-85r7b" event={"ID":"99cf2572-ac8e-4bcf-8c00-aba0ac0f5934","Type":"ContainerDied","Data":"66fa1642763ac88ef7c179272b21f6559d7f5f6dd5d46386f6c7df84f01e8ed4"}
Jul 16 13:00:08.748603 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:00:08.748527    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66fa1642763ac88ef7c179272b21f6559d7f5f6dd5d46386f6c7df84f01e8ed4"
Jul 16 13:02:17.687909 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:02:17.687858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:03:05.089621 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:03:05.089583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:03:05.256749 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:03:05.256712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:03:24.405240 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:03:24.405154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:04:17.288894 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:17.288862    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"]
Jul 16 13:04:17.289417 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:17.289046    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z" podUID="783e7863-bebe-42ab-835f-c467e3735177" containerName="manager" containerID="cri-o://ea37dbcb07ebc0f7965df6bc550570a6c0308de092f90460f1069f3d35735323" gracePeriod=10
Jul 16 13:04:20.943643 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:20.943552    2564 generic.go:356] "Generic (PLEG): container finished" podID="783e7863-bebe-42ab-835f-c467e3735177" containerID="ea37dbcb07ebc0f7965df6bc550570a6c0308de092f90460f1069f3d35735323" exitCode=0
Jul 16 13:04:20.943643 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:20.943595    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z" event={"ID":"783e7863-bebe-42ab-835f-c467e3735177","Type":"ContainerDied","Data":"ea37dbcb07ebc0f7965df6bc550570a6c0308de092f90460f1069f3d35735323"}
Jul 16 13:04:21.248381 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.248353    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 13:04:21.267643 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.267608    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wxbx\" (UniqueName: \"kubernetes.io/projected/783e7863-bebe-42ab-835f-c467e3735177-kube-api-access-5wxbx\") pod \"783e7863-bebe-42ab-835f-c467e3735177\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") "
Jul 16 13:04:21.267822 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.267690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/783e7863-bebe-42ab-835f-c467e3735177-extensions-socket-volume\") pod \"783e7863-bebe-42ab-835f-c467e3735177\" (UID: \"783e7863-bebe-42ab-835f-c467e3735177\") "
Jul 16 13:04:21.268087 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.268049    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/783e7863-bebe-42ab-835f-c467e3735177-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "783e7863-bebe-42ab-835f-c467e3735177" (UID: "783e7863-bebe-42ab-835f-c467e3735177"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:04:21.269841 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.269819    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/783e7863-bebe-42ab-835f-c467e3735177-kube-api-access-5wxbx" (OuterVolumeSpecName: "kube-api-access-5wxbx") pod "783e7863-bebe-42ab-835f-c467e3735177" (UID: "783e7863-bebe-42ab-835f-c467e3735177"). InnerVolumeSpecName "kube-api-access-5wxbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:04:21.369315 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.369279    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wxbx\" (UniqueName: \"kubernetes.io/projected/783e7863-bebe-42ab-835f-c467e3735177-kube-api-access-5wxbx\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:04:21.369315 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.369312    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/783e7863-bebe-42ab-835f-c467e3735177-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:04:21.949450 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.949409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z" event={"ID":"783e7863-bebe-42ab-835f-c467e3735177","Type":"ContainerDied","Data":"730e803b9c20b4bbc99cb936dc613df3474de3fe580354b4d99cafa8bc3fff8b"}
Jul 16 13:04:21.949910 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.949470    2564 scope.go:117] "RemoveContainer" containerID="ea37dbcb07ebc0f7965df6bc550570a6c0308de092f90460f1069f3d35735323"
Jul 16 13:04:21.949910 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.949425    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"
Jul 16 13:04:21.974329 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.974290    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"]
Jul 16 13:04:21.981028 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:21.981001    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-75d2z"]
Jul 16 13:04:22.834589 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:04:22.834558    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="783e7863-bebe-42ab-835f-c467e3735177" path="/var/lib/kubelet/pods/783e7863-bebe-42ab-835f-c467e3735177/volumes"
Jul 16 13:05:19.036183 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.036144    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"]
Jul 16 13:05:19.036594 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.036505    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="783e7863-bebe-42ab-835f-c467e3735177" containerName="manager"
Jul 16 13:05:19.036594 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.036516    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="783e7863-bebe-42ab-835f-c467e3735177" containerName="manager"
Jul 16 13:05:19.036594 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.036529    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99cf2572-ac8e-4bcf-8c00-aba0ac0f5934" containerName="cleanup"
Jul 16 13:05:19.036594 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.036535    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="99cf2572-ac8e-4bcf-8c00-aba0ac0f5934" containerName="cleanup"
Jul 16 13:05:19.036594 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.036588    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="99cf2572-ac8e-4bcf-8c00-aba0ac0f5934" containerName="cleanup"
Jul 16 13:05:19.036594 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.036595    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="783e7863-bebe-42ab-835f-c467e3735177" containerName="manager"
Jul 16 13:05:19.040825 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.040806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.043801 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.043780    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 13:05:19.044837 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.044816    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fh5x6\""
Jul 16 13:05:19.044934 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.044883    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 13:05:19.071822 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.071795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"]
Jul 16 13:05:19.169976 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.169941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7zt\" (UniqueName: \"kubernetes.io/projected/bac3cea1-5168-4908-b352-a5ed05890d16-kube-api-access-kt7zt\") pod \"kuadrant-operator-controller-manager-86878c769f-9tj5p\" (UID: \"bac3cea1-5168-4908-b352-a5ed05890d16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.170203 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.169993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac3cea1-5168-4908-b352-a5ed05890d16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9tj5p\" (UID: \"bac3cea1-5168-4908-b352-a5ed05890d16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.270968 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.270926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7zt\" (UniqueName: \"kubernetes.io/projected/bac3cea1-5168-4908-b352-a5ed05890d16-kube-api-access-kt7zt\") pod \"kuadrant-operator-controller-manager-86878c769f-9tj5p\" (UID: \"bac3cea1-5168-4908-b352-a5ed05890d16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.271204 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.270988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac3cea1-5168-4908-b352-a5ed05890d16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9tj5p\" (UID: \"bac3cea1-5168-4908-b352-a5ed05890d16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.271370 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.271353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bac3cea1-5168-4908-b352-a5ed05890d16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9tj5p\" (UID: \"bac3cea1-5168-4908-b352-a5ed05890d16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.287081 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.287018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7zt\" (UniqueName: \"kubernetes.io/projected/bac3cea1-5168-4908-b352-a5ed05890d16-kube-api-access-kt7zt\") pod \"kuadrant-operator-controller-manager-86878c769f-9tj5p\" (UID: \"bac3cea1-5168-4908-b352-a5ed05890d16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.351205 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.351165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:19.499035 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:19.499013    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"]
Jul 16 13:05:19.502371 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:05:19.502347    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac3cea1_5168_4908_b352_a5ed05890d16.slice/crio-17361c7ac4bda6b35231ec443165c4dfcdefdeb2005acab1a79981e688584173 WatchSource:0}: Error finding container 17361c7ac4bda6b35231ec443165c4dfcdefdeb2005acab1a79981e688584173: Status 404 returned error can't find the container with id 17361c7ac4bda6b35231ec443165c4dfcdefdeb2005acab1a79981e688584173
Jul 16 13:05:20.231053 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:20.231016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p" event={"ID":"bac3cea1-5168-4908-b352-a5ed05890d16","Type":"ContainerStarted","Data":"b5d2dcae42b3c40c9872fcedcde2c774fe42f78d4fbbddc3ad4cef94921f5eb5"}
Jul 16 13:05:20.231465 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:20.231076    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p" event={"ID":"bac3cea1-5168-4908-b352-a5ed05890d16","Type":"ContainerStarted","Data":"17361c7ac4bda6b35231ec443165c4dfcdefdeb2005acab1a79981e688584173"}
Jul 16 13:05:20.231465 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:20.231104    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:05:20.258335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:20.258287    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p" podStartSLOduration=2.258267722 podStartE2EDuration="2.258267722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:05:20.255554293 +0000 UTC m=+1203.994544110" watchObservedRunningTime="2026-07-16 13:05:20.258267722 +0000 UTC m=+1203.997257501"
Jul 16 13:05:31.238419 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:05:31.238388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9tj5p"
Jul 16 13:07:33.887159 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:07:33.887125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:07:37.305702 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:07:37.305667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:07:55.225337 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:07:55.225251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:07:55.335560 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:07:55.335525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:08:21.669981 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:08:21.669944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:10:54.982251 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:10:54.982163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:23.058823 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:23.058781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:34.897042 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:34.896993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:43.196779 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:43.196741    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:48.452135 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:48.449742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:51.601804 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:51.601764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:51.704303 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:51.704269    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:52.171179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:52.171127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:59.336135 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:59.336073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:59.726186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:59.726088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:59.848679 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:59.848645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:11:59.932545 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:59.932515    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"]
Jul 16 13:11:59.936076 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:59.936051    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:11:59.940616 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:59.940597    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0428f520-openshift-default-dockercfg-gdntr\""
Jul 16 13:11:59.982773 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:11:59.982699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"]
Jul 16 13:12:00.104649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.104614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:00.105797 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-envoy\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.105856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-data\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.105856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-credential-socket\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.105940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-podinfo\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.105940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-token\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.105940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jxjn\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-kube-api-access-6jxjn\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.106048 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-certs\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.106048 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.105995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istiod-ca-cert\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.106048 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.106025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-socket\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.205617 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.205584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:00.206686 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-certs\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.206815 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istiod-ca-cert\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.206815 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-socket\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.206815 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-envoy\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.206969 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-data\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.206969 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-credential-socket\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.206969 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-podinfo\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.207191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.206994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-token\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.207191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.207135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-certs\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.207191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.207186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxjn\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-kube-api-access-6jxjn\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.207335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.207202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-socket\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.207383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.207346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-data\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.207424 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.207387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-credential-socket\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.207516 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.207492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istiod-ca-cert\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.209244 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.209224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-envoy\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.209451 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.209431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-podinfo\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.217837 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.217817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-token\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.218591 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.218573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxjn\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-kube-api-access-6jxjn\") pod \"e2e-ait-0428f520-openshift-default-6b448df745-xmn5q\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") " pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.246701 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.246635    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:00.398799 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.398774    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"]
Jul 16 13:12:00.401251 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:12:00.401222    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370fa824_70c7_42b7_b80c_c1d4ef682f6e.slice/crio-504c01712dd0c0f790dbfcaf93e08a17f1e7401c47450a0b71d635bf63ff6bce WatchSource:0}: Error finding container 504c01712dd0c0f790dbfcaf93e08a17f1e7401c47450a0b71d635bf63ff6bce: Status 404 returned error can't find the container with id 504c01712dd0c0f790dbfcaf93e08a17f1e7401c47450a0b71d635bf63ff6bce
Jul 16 13:12:00.403126 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:00.403091    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 13:12:01.134446 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.134412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" event={"ID":"370fa824-70c7-42b7-b80c-c1d4ef682f6e","Type":"ContainerStarted","Data":"504c01712dd0c0f790dbfcaf93e08a17f1e7401c47450a0b71d635bf63ff6bce"}
Jul 16 13:12:01.183951 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.183906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:01.410222 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.410134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:01.457703 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.457668    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"]
Jul 16 13:12:01.461858 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.461838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.466068 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.466048    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0428f520-serving-cert\""
Jul 16 13:12:01.475929 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.475902    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"]
Jul 16 13:12:01.573052 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.573023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:01.618615 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.618588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcwfs\" (UniqueName: \"kubernetes.io/projected/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-kube-api-access-hcwfs\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.618719 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.618626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-openshift-service-ca\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.618762 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.618721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.719335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.719256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.719335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.719308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcwfs\" (UniqueName: \"kubernetes.io/projected/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-kube-api-access-hcwfs\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.719335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.719332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-openshift-service-ca\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.719572 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:12:01.719414    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-serving-cert: secret "maas-api-e2e-ait-0428f520-serving-cert" not found
Jul 16 13:12:01.719572 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:12:01.719479    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls podName:c8f429a1-0b91-46ea-8c3f-bdaedc072fb4 nodeName:}" failed. No retries permitted until 2026-07-16 13:12:02.219462782 +0000 UTC m=+1605.958452540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls") pod "maas-api-e2e-ait-0428f520-87b5fc577-pk8gp" (UID: "c8f429a1-0b91-46ea-8c3f-bdaedc072fb4") : secret "maas-api-e2e-ait-0428f520-serving-cert" not found
Jul 16 13:12:01.719958 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.719940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-openshift-service-ca\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.736259 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.736229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcwfs\" (UniqueName: \"kubernetes.io/projected/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-kube-api-access-hcwfs\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:01.866226 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:01.866182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:02.224138 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:02.224077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:02.226666 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:02.226633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls\") pod \"maas-api-e2e-ait-0428f520-87b5fc577-pk8gp\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:02.280296 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:02.280263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:02.372569 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:02.372533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:02.527626 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:02.527539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"]
Jul 16 13:12:02.531327 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:12:02.531291    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f429a1_0b91_46ea_8c3f_bdaedc072fb4.slice/crio-2c6ae849c4a85c26da0305b65902e5ab0f6071836c69a84ab89de2e051c51086 WatchSource:0}: Error finding container 2c6ae849c4a85c26da0305b65902e5ab0f6071836c69a84ab89de2e051c51086: Status 404 returned error can't find the container with id 2c6ae849c4a85c26da0305b65902e5ab0f6071836c69a84ab89de2e051c51086
Jul 16 13:12:02.582516 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:02.582485    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:03.145940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:03.145901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp" event={"ID":"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4","Type":"ContainerStarted","Data":"2c6ae849c4a85c26da0305b65902e5ab0f6071836c69a84ab89de2e051c51086"}
Jul 16 13:12:03.724165 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:03.724096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:04.152456 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:04.152422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp" event={"ID":"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4","Type":"ContainerStarted","Data":"bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13"}
Jul 16 13:12:04.152647 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:04.152496    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:04.194525 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:04.194476    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp" podStartSLOduration=2.465288016 podStartE2EDuration="3.194458442s" totalImagesPullingTime="729.170426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:12:04.193026322 +0000 UTC m=+1607.932016102" watchObservedRunningTime="2026-07-16 13:12:04.194458442 +0000 UTC m=+1607.933448248"
Jul 16 13:12:06.182524 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.182484    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"]
Jul 16 13:12:06.191873 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.191831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"
Jul 16 13:12:06.194955 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.194918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:12:06.200188 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.200055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"]
Jul 16 13:12:06.366617 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.366579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ddc3e8-2720-45ea-a33c-ab18e7d252d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0428f520-brcm8\" (UID: \"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"
Jul 16 13:12:06.398622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.398584    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:12:06.398743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.398654    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:12:06.398743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.398688    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:12:06.467464 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.467426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ddc3e8-2720-45ea-a33c-ab18e7d252d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0428f520-brcm8\" (UID: \"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"
Jul 16 13:12:06.468169 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.468146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ddc3e8-2720-45ea-a33c-ab18e7d252d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0428f520-brcm8\" (UID: \"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"
Jul 16 13:12:06.506261 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.506218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"
Jul 16 13:12:06.684030 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:06.683990    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"]
Jul 16 13:12:06.688316 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:12:06.688265    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ddc3e8_2720_45ea_a33c_ab18e7d252d3.slice/crio-2da956055ca87041de4e7b8a66685919e19b1858616bb199563bbcdff0f6c7ce WatchSource:0}: Error finding container 2da956055ca87041de4e7b8a66685919e19b1858616bb199563bbcdff0f6c7ce: Status 404 returned error can't find the container with id 2da956055ca87041de4e7b8a66685919e19b1858616bb199563bbcdff0f6c7ce
Jul 16 13:12:07.171308 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:07.171266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" event={"ID":"370fa824-70c7-42b7-b80c-c1d4ef682f6e","Type":"ContainerStarted","Data":"00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878"}
Jul 16 13:12:07.172700 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:07.172672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" event={"ID":"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3","Type":"ContainerStarted","Data":"f81a72008761eb8a8677262304b73f6b99e8bb23e60ebf9b8a3338e0dfa707e3"}
Jul 16 13:12:07.172829 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:07.172721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" event={"ID":"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3","Type":"ContainerStarted","Data":"2da956055ca87041de4e7b8a66685919e19b1858616bb199563bbcdff0f6c7ce"}
Jul 16 13:12:07.227017 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:07.226898    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" podStartSLOduration=2.231884091 podStartE2EDuration="8.226879813s" totalImagesPullingTime="5.994995722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:12:07.226318911 +0000 UTC m=+1610.965308690" watchObservedRunningTime="2026-07-16 13:12:07.226879813 +0000 UTC m=+1610.965869591"
Jul 16 13:12:07.247285 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:07.247257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:07.252294 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:07.252265    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:07.262921 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:07.262874    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" podStartSLOduration=1.262859807 podStartE2EDuration="1.262859807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:12:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:12:07.261204018 +0000 UTC m=+1611.000193809" watchObservedRunningTime="2026-07-16 13:12:07.262859807 +0000 UTC m=+1611.001849586"
Jul 16 13:12:08.179388 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:08.179352    2564 generic.go:356] "Generic (PLEG): container finished" podID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerID="f81a72008761eb8a8677262304b73f6b99e8bb23e60ebf9b8a3338e0dfa707e3" exitCode=7
Jul 16 13:12:08.179581 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:08.179435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" event={"ID":"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3","Type":"ContainerDied","Data":"f81a72008761eb8a8677262304b73f6b99e8bb23e60ebf9b8a3338e0dfa707e3"}
Jul 16 13:12:08.179697 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:08.179677    2564 scope.go:117] "RemoveContainer" containerID="f81a72008761eb8a8677262304b73f6b99e8bb23e60ebf9b8a3338e0dfa707e3"
Jul 16 13:12:08.179858 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:08.179840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:08.180802 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:08.180786    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:09.186287 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:09.186255    2564 generic.go:356] "Generic (PLEG): container finished" podID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerID="6ae46fcd2e3dcce697271d0c4ded5cace8db93e6b619f639c06fb45e6ab7578c" exitCode=7
Jul 16 13:12:09.186776 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:09.186345    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" event={"ID":"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3","Type":"ContainerDied","Data":"6ae46fcd2e3dcce697271d0c4ded5cace8db93e6b619f639c06fb45e6ab7578c"}
Jul 16 13:12:09.186776 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:09.186415    2564 scope.go:117] "RemoveContainer" containerID="f81a72008761eb8a8677262304b73f6b99e8bb23e60ebf9b8a3338e0dfa707e3"
Jul 16 13:12:09.186776 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:09.186485    2564 scope.go:117] "RemoveContainer" containerID="6ae46fcd2e3dcce697271d0c4ded5cace8db93e6b619f639c06fb45e6ab7578c"
Jul 16 13:12:09.186776 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:12:09.186726    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0428f520-brcm8_odh-ai-gateway-infra(c4ddc3e8-2720-45ea-a33c-ab18e7d252d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3"
Jul 16 13:12:10.164480 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:10.164445    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:12:10.194260 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:10.194177    2564 scope.go:117] "RemoveContainer" containerID="6ae46fcd2e3dcce697271d0c4ded5cace8db93e6b619f639c06fb45e6ab7578c"
Jul 16 13:12:10.194686 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:12:10.194371    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0428f520-brcm8_odh-ai-gateway-infra(c4ddc3e8-2720-45ea-a33c-ab18e7d252d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3"
Jul 16 13:12:17.195651 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:17.195607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:12:18.238527 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:18.238495    2564 generic.go:356] "Generic (PLEG): container finished" podID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerID="00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878" exitCode=0
Jul 16 13:12:18.238527 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:18.238529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" event={"ID":"370fa824-70c7-42b7-b80c-c1d4ef682f6e","Type":"ContainerDied","Data":"00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878"}
Jul 16 13:12:18.238994 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:18.238890    2564 scope.go:117] "RemoveContainer" containerID="00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878"
Jul 16 13:12:18.239889 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:18.239856    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:12:18.239996 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:18.239943    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:12:18.240066 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:18.239993    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:12:19.249172 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:19.249124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" event={"ID":"370fa824-70c7-42b7-b80c-c1d4ef682f6e","Type":"ContainerStarted","Data":"845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e"}
Jul 16 13:12:20.247608 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:20.247397    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:20.248605 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:20.248568    2564 patch_prober.go:28] interesting pod/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 16 13:12:20.248730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:20.248625    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 16 13:12:21.247006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:21.246961    2564 patch_prober.go:28] interesting pod/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 16 13:12:21.247625 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:21.247591    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 16 13:12:22.247617 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:22.247576    2564 patch_prober.go:28] interesting pod/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 16 13:12:22.248237 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:22.248197    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 16 13:12:22.828351 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:22.828318    2564 scope.go:117] "RemoveContainer" containerID="6ae46fcd2e3dcce697271d0c4ded5cace8db93e6b619f639c06fb45e6ab7578c"
Jul 16 13:12:23.180306 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:23.180269    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:23.251194 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:23.251165    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:23.271398 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:23.271362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" event={"ID":"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3","Type":"ContainerStarted","Data":"3f65e8e784156f72347119ffc3eda6050af143ef4443e1499635d9f44a4c5058"}
Jul 16 13:12:23.272398 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:23.272380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:12:24.277634 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:24.277602    2564 generic.go:356] "Generic (PLEG): container finished" podID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerID="3f65e8e784156f72347119ffc3eda6050af143ef4443e1499635d9f44a4c5058" exitCode=0
Jul 16 13:12:24.278033 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:24.277675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" event={"ID":"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3","Type":"ContainerDied","Data":"3f65e8e784156f72347119ffc3eda6050af143ef4443e1499635d9f44a4c5058"}
Jul 16 13:12:24.278033 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:24.277770    2564 scope.go:117] "RemoveContainer" containerID="6ae46fcd2e3dcce697271d0c4ded5cace8db93e6b619f639c06fb45e6ab7578c"
Jul 16 13:12:24.368465 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:24.368431    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"]
Jul 16 13:12:25.422298 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:25.422266    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"
Jul 16 13:12:25.557433 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:25.557340    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ddc3e8-2720-45ea-a33c-ab18e7d252d3-maas-api-service-ca\") pod \"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3\" (UID: \"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3\") "
Jul 16 13:12:25.557751 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:25.557721    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4ddc3e8-2720-45ea-a33c-ab18e7d252d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" (UID: "c4ddc3e8-2720-45ea-a33c-ab18e7d252d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:12:25.658921 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:25.658882    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ddc3e8-2720-45ea-a33c-ab18e7d252d3-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:12:26.291205 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:26.291175    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"
Jul 16 13:12:26.291377 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:26.291177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8" event={"ID":"c4ddc3e8-2720-45ea-a33c-ab18e7d252d3","Type":"ContainerDied","Data":"2da956055ca87041de4e7b8a66685919e19b1858616bb199563bbcdff0f6c7ce"}
Jul 16 13:12:26.291377 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:26.291303    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2da956055ca87041de4e7b8a66685919e19b1858616bb199563bbcdff0f6c7ce"
Jul 16 13:12:26.347377 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:26.347339    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"]
Jul 16 13:12:26.356907 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:26.356876    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-brcm8"]
Jul 16 13:12:26.834843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:12:26.834815    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" path="/var/lib/kubelet/pods/c4ddc3e8-2720-45ea-a33c-ab18e7d252d3/volumes"
Jul 16 13:13:06.247571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.247528    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"]
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.247907    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.247919    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.247939    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.247945    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.247952    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.247958    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.248007    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.248061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.248028    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:06.251302 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.251282    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"
Jul 16 13:13:06.254011 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.253990    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:13:06.260564 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.260535    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"]
Jul 16 13:13:06.298657 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.298617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/309ab0dc-285f-44a6-a2d3-d93cec74fc5d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0428f520-pj54z\" (UID: \"309ab0dc-285f-44a6-a2d3-d93cec74fc5d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"
Jul 16 13:13:06.399654 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.399620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/309ab0dc-285f-44a6-a2d3-d93cec74fc5d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0428f520-pj54z\" (UID: \"309ab0dc-285f-44a6-a2d3-d93cec74fc5d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"
Jul 16 13:13:06.400298 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.400277    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/309ab0dc-285f-44a6-a2d3-d93cec74fc5d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0428f520-pj54z\" (UID: \"309ab0dc-285f-44a6-a2d3-d93cec74fc5d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"
Jul 16 13:13:06.563179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.563074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"
Jul 16 13:13:06.700690 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:06.700663    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"]
Jul 16 13:13:06.703444 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:13:06.703415    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309ab0dc_285f_44a6_a2d3_d93cec74fc5d.slice/crio-6474e8e6128fdbd9156f872cf7d1a9af1292fc7edeaf2420ad0d955a1b17b052 WatchSource:0}: Error finding container 6474e8e6128fdbd9156f872cf7d1a9af1292fc7edeaf2420ad0d955a1b17b052: Status 404 returned error can't find the container with id 6474e8e6128fdbd9156f872cf7d1a9af1292fc7edeaf2420ad0d955a1b17b052
Jul 16 13:13:07.483502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:07.483473    2564 generic.go:356] "Generic (PLEG): container finished" podID="309ab0dc-285f-44a6-a2d3-d93cec74fc5d" containerID="739b3b8b3539709bfe4387b20c18e15ff8caf8e0472e395edf97827134301661" exitCode=0
Jul 16 13:13:07.483898 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:07.483558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z" event={"ID":"309ab0dc-285f-44a6-a2d3-d93cec74fc5d","Type":"ContainerDied","Data":"739b3b8b3539709bfe4387b20c18e15ff8caf8e0472e395edf97827134301661"}
Jul 16 13:13:07.483898 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:07.483610    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z" event={"ID":"309ab0dc-285f-44a6-a2d3-d93cec74fc5d","Type":"ContainerStarted","Data":"6474e8e6128fdbd9156f872cf7d1a9af1292fc7edeaf2420ad0d955a1b17b052"}
Jul 16 13:13:08.623412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:08.623385    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"
Jul 16 13:13:08.722232 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:08.722195    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/309ab0dc-285f-44a6-a2d3-d93cec74fc5d-maas-api-service-ca\") pod \"309ab0dc-285f-44a6-a2d3-d93cec74fc5d\" (UID: \"309ab0dc-285f-44a6-a2d3-d93cec74fc5d\") "
Jul 16 13:13:08.722639 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:08.722582    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/309ab0dc-285f-44a6-a2d3-d93cec74fc5d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "309ab0dc-285f-44a6-a2d3-d93cec74fc5d" (UID: "309ab0dc-285f-44a6-a2d3-d93cec74fc5d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:13:08.823775 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:08.823664    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/309ab0dc-285f-44a6-a2d3-d93cec74fc5d-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:09.495028 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:09.494999    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z"
Jul 16 13:13:09.495214 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:09.495048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0428f520-pj54z" event={"ID":"309ab0dc-285f-44a6-a2d3-d93cec74fc5d","Type":"ContainerDied","Data":"6474e8e6128fdbd9156f872cf7d1a9af1292fc7edeaf2420ad0d955a1b17b052"}
Jul 16 13:13:09.495214 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:09.495092    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6474e8e6128fdbd9156f872cf7d1a9af1292fc7edeaf2420ad0d955a1b17b052"
Jul 16 13:13:16.962786 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:16.962750    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"]
Jul 16 13:13:16.963185 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:16.962953    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp" podUID="c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" containerName="maas-api" containerID="cri-o://bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13" gracePeriod=30
Jul 16 13:13:16.997315 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:16.997287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:17.219666 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.219591    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:13:17.303099 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.303067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-openshift-service-ca\") pod \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") "
Jul 16 13:13:17.303310 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.303131    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcwfs\" (UniqueName: \"kubernetes.io/projected/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-kube-api-access-hcwfs\") pod \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") "
Jul 16 13:13:17.303310 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.303157    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls\") pod \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\" (UID: \"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4\") "
Jul 16 13:13:17.303445 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.303420    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" (UID: "c8f429a1-0b91-46ea-8c3f-bdaedc072fb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:13:17.305347 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.305323    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-kube-api-access-hcwfs" (OuterVolumeSpecName: "kube-api-access-hcwfs") pod "c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" (UID: "c8f429a1-0b91-46ea-8c3f-bdaedc072fb4"). InnerVolumeSpecName "kube-api-access-hcwfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:13:17.305463 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.305352    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" (UID: "c8f429a1-0b91-46ea-8c3f-bdaedc072fb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:13:17.404692 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.404660    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:17.404692 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.404686    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcwfs\" (UniqueName: \"kubernetes.io/projected/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-kube-api-access-hcwfs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:17.404692 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.404696    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:17.535470 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.535375    2564 generic.go:356] "Generic (PLEG): container finished" podID="c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" containerID="bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13" exitCode=0
Jul 16 13:13:17.535470 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.535417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp" event={"ID":"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4","Type":"ContainerDied","Data":"bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13"}
Jul 16 13:13:17.535701 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.535429    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"
Jul 16 13:13:17.535701 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.535487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp" event={"ID":"c8f429a1-0b91-46ea-8c3f-bdaedc072fb4","Type":"ContainerDied","Data":"2c6ae849c4a85c26da0305b65902e5ab0f6071836c69a84ab89de2e051c51086"}
Jul 16 13:13:17.535701 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.535520    2564 scope.go:117] "RemoveContainer" containerID="bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13"
Jul 16 13:13:17.544555 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.544534    2564 scope.go:117] "RemoveContainer" containerID="bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13"
Jul 16 13:13:17.544793 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:13:17.544773    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13\": container with ID starting with bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13 not found: ID does not exist" containerID="bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13"
Jul 16 13:13:17.544841 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.544803    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13"} err="failed to get container status \"bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13\": rpc error: code = NotFound desc = could not find container \"bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13\": container with ID starting with bc32940a855149fb6ad5b8b9f009da2938b9de2f66897f8acc5eaa5c4497ae13 not found: ID does not exist"
Jul 16 13:13:17.562686 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.562661    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"]
Jul 16 13:13:17.566051 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:17.566029    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0428f520-87b5fc577-pk8gp"]
Jul 16 13:13:18.834262 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:18.834230    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" path="/var/lib/kubelet/pods/c8f429a1-0b91-46ea-8c3f-bdaedc072fb4/volumes"
Jul 16 13:13:21.384926 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:21.384892    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:27.951536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:27.951502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:28.047293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:28.047262    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:31.574716 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:31.574678    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"]
Jul 16 13:13:31.575218 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:31.574928    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy" containerID="cri-o://845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e" gracePeriod=30
Jul 16 13:13:31.600335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:31.600297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:32.004619 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.004583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:32.102826 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.102794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:32.158962 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.158929    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"]
Jul 16 13:13:32.159533 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.159516    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="309ab0dc-285f-44a6-a2d3-d93cec74fc5d" containerName="revoke-keys"
Jul 16 13:13:32.159578 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.159537    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="309ab0dc-285f-44a6-a2d3-d93cec74fc5d" containerName="revoke-keys"
Jul 16 13:13:32.159578 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.159568    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" containerName="maas-api"
Jul 16 13:13:32.159650 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.159577    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" containerName="maas-api"
Jul 16 13:13:32.159684 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.159659    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ddc3e8-2720-45ea-a33c-ab18e7d252d3" containerName="revoke-keys"
Jul 16 13:13:32.159684 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.159673    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="309ab0dc-285f-44a6-a2d3-d93cec74fc5d" containerName="revoke-keys"
Jul 16 13:13:32.159745 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.159684    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f429a1-0b91-46ea-8c3f-bdaedc072fb4" containerName="maas-api"
Jul 16 13:13:32.163241 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.163214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.165926 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.165900    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f8d4b9eb-gw-openshift-default-dockercfg-hd94x\""
Jul 16 13:13:32.179607 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.179585    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"]
Jul 16 13:13:32.234903 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.234873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:32.242006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.241963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-data\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-socket\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mljl\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-kube-api-access-5mljl\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-certs\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-istio-token\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3488aa54-f855-4999-82e5-721545677aef-istiod-ca-cert\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-envoy\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242372 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-credential-socket\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.242372 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.242288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3488aa54-f855-4999-82e5-721545677aef-istio-podinfo\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343514 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3488aa54-f855-4999-82e5-721545677aef-istio-podinfo\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-data\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-socket\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mljl\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-kube-api-access-5mljl\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-certs\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-istio-token\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343981 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3488aa54-f855-4999-82e5-721545677aef-istiod-ca-cert\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343981 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-envoy\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.343981 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.343792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-credential-socket\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.344171 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.344138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-data\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.344242 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.344169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-certs\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.344242 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.344215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-credential-socket\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.344408 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.344389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-socket\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.344709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.344690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3488aa54-f855-4999-82e5-721545677aef-istiod-ca-cert\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.346424 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.346399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-envoy\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.346863 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.346844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3488aa54-f855-4999-82e5-721545677aef-istio-podinfo\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.355253 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.355232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-istio-token\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.355355 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.355282    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mljl\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-kube-api-access-5mljl\") pod \"e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") " pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.476743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.476703    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:32.629859 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.629835    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"]
Jul 16 13:13:32.632703 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:13:32.632667    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3488aa54_f855_4999_82e5_721545677aef.slice/crio-8e27bb9fa969e6facc8111e74bedc0fa090d36bdcfbe674e0f773882e491c903 WatchSource:0}: Error finding container 8e27bb9fa969e6facc8111e74bedc0fa090d36bdcfbe674e0f773882e491c903: Status 404 returned error can't find the container with id 8e27bb9fa969e6facc8111e74bedc0fa090d36bdcfbe674e0f773882e491c903
Jul 16 13:13:32.634838 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.634802    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:13:32.635396 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.635359    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:13:32.635676 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:32.635643    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:13:33.618249 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.618206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" event={"ID":"3488aa54-f855-4999-82e5-721545677aef","Type":"ContainerStarted","Data":"69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36"}
Jul 16 13:13:33.618437 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.618271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" event={"ID":"3488aa54-f855-4999-82e5-721545677aef","Type":"ContainerStarted","Data":"8e27bb9fa969e6facc8111e74bedc0fa090d36bdcfbe674e0f773882e491c903"}
Jul 16 13:13:33.658706 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.658651    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" podStartSLOduration=1.6586338189999998 podStartE2EDuration="1.658633819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:13:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:13:33.656912698 +0000 UTC m=+1697.395902495" watchObservedRunningTime="2026-07-16 13:13:33.658633819 +0000 UTC m=+1697.397623598"
Jul 16 13:13:33.709826 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.709793    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"]
Jul 16 13:13:33.713490 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.713465    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.718807 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.718691    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f8d4b9eb-serving-cert\""
Jul 16 13:13:33.733138 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.732892    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"]
Jul 16 13:13:33.860421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.860383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92df48a4-6587-4359-b89b-43dc404f1dfd-openshift-service-ca\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.860421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.860432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92df48a4-6587-4359-b89b-43dc404f1dfd-maas-api-tls\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.860686 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.860545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rlcm\" (UniqueName: \"kubernetes.io/projected/92df48a4-6587-4359-b89b-43dc404f1dfd-kube-api-access-5rlcm\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.961412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.961319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92df48a4-6587-4359-b89b-43dc404f1dfd-openshift-service-ca\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.961412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.961390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92df48a4-6587-4359-b89b-43dc404f1dfd-maas-api-tls\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.961644 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.961460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rlcm\" (UniqueName: \"kubernetes.io/projected/92df48a4-6587-4359-b89b-43dc404f1dfd-kube-api-access-5rlcm\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.962000 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.961976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92df48a4-6587-4359-b89b-43dc404f1dfd-openshift-service-ca\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.964004 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.963983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92df48a4-6587-4359-b89b-43dc404f1dfd-maas-api-tls\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:33.981818 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:33.981794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rlcm\" (UniqueName: \"kubernetes.io/projected/92df48a4-6587-4359-b89b-43dc404f1dfd-kube-api-access-5rlcm\") pod \"maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:34.027718 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.027672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:34.169979 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.169953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"]
Jul 16 13:13:34.171344 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:13:34.171320    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92df48a4_6587_4359_b89b_43dc404f1dfd.slice/crio-72e9db5fdc169c26772248e5fed8d0adca488c10d1222143e753917839b65054 WatchSource:0}: Error finding container 72e9db5fdc169c26772248e5fed8d0adca488c10d1222143e753917839b65054: Status 404 returned error can't find the container with id 72e9db5fdc169c26772248e5fed8d0adca488c10d1222143e753917839b65054
Jul 16 13:13:34.387716 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.387682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:34.477338 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.477306    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:34.482349 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.482321    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:34.489265 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.489239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:34.625305 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.625222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl" event={"ID":"92df48a4-6587-4359-b89b-43dc404f1dfd","Type":"ContainerStarted","Data":"72e9db5fdc169c26772248e5fed8d0adca488c10d1222143e753917839b65054"}
Jul 16 13:13:34.625522 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.625462    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:34.625711 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.625685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:34.626474 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.626453    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:34.728411 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:34.728374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:35.633923 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:35.633883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl" event={"ID":"92df48a4-6587-4359-b89b-43dc404f1dfd","Type":"ContainerStarted","Data":"19d8af1ab94fb79c864923fbb671a19b760675814607b33cbee6809860fa9530"}
Jul 16 13:13:35.665146 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:35.665077    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl" podStartSLOduration=2.113332103 podStartE2EDuration="2.66506027s" totalImagesPullingTime="551.728167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:13:35.664765169 +0000 UTC m=+1699.403754946" watchObservedRunningTime="2026-07-16 13:13:35.66506027 +0000 UTC m=+1699.404050049"
Jul 16 13:13:36.640125 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.640075    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:36.839362 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.839296    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:13:36.989149 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989092    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-envoy\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989325 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989189    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-data\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989325 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989228    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-credential-socket\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989325 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989250    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-socket\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989325 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989277    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-token\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989325 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989312    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istiod-ca-cert\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989582 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989364    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-podinfo\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989582 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989388    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jxjn\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-kube-api-access-6jxjn\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989582 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989412    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-certs\") pod \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\" (UID: \"370fa824-70c7-42b7-b80c-c1d4ef682f6e\") "
Jul 16 13:13:36.989582 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989556    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:13:36.989792 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989727    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:13:36.989792 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989779    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:13:36.989906 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989812    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:36.989906 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989831    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:36.990129 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.989993    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:13:36.990129 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.990076    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:13:36.991795 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.991765    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:13:36.991906 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.991822    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-kube-api-access-6jxjn" (OuterVolumeSpecName: "kube-api-access-6jxjn") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "kube-api-access-6jxjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:13:36.991906 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.991858    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:13:36.991906 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:36.991871    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "370fa824-70c7-42b7-b80c-c1d4ef682f6e" (UID: "370fa824-70c7-42b7-b80c-c1d4ef682f6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:13:37.091043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.090949    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:37.091043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.090981    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:37.091043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.090995    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:37.091043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.091006    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:37.091043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.091018    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:37.091043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.091029    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jxjn\" (UniqueName: \"kubernetes.io/projected/370fa824-70c7-42b7-b80c-c1d4ef682f6e-kube-api-access-6jxjn\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:37.091043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.091041    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370fa824-70c7-42b7-b80c-c1d4ef682f6e-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:37.646385 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.646344    2564 generic.go:356] "Generic (PLEG): container finished" podID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerID="845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e" exitCode=0
Jul 16 13:13:37.646891 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.646396    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"
Jul 16 13:13:37.646891 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.646425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" event={"ID":"370fa824-70c7-42b7-b80c-c1d4ef682f6e","Type":"ContainerDied","Data":"845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e"}
Jul 16 13:13:37.646891 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.646481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q" event={"ID":"370fa824-70c7-42b7-b80c-c1d4ef682f6e","Type":"ContainerDied","Data":"504c01712dd0c0f790dbfcaf93e08a17f1e7401c47450a0b71d635bf63ff6bce"}
Jul 16 13:13:37.646891 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.646503    2564 scope.go:117] "RemoveContainer" containerID="845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e"
Jul 16 13:13:37.655983 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.655965    2564 scope.go:117] "RemoveContainer" containerID="00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878"
Jul 16 13:13:37.663535 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.663519    2564 scope.go:117] "RemoveContainer" containerID="845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e"
Jul 16 13:13:37.663792 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:13:37.663771    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e\": container with ID starting with 845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e not found: ID does not exist" containerID="845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e"
Jul 16 13:13:37.663839 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.663803    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e"} err="failed to get container status \"845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e\": rpc error: code = NotFound desc = could not find container \"845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e\": container with ID starting with 845ffff9b44a0e26a57e71953825dc0be8b9930a6b6893f25165606698a9525e not found: ID does not exist"
Jul 16 13:13:37.663839 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.663821    2564 scope.go:117] "RemoveContainer" containerID="00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878"
Jul 16 13:13:37.664053 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:13:37.664034    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878\": container with ID starting with 00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878 not found: ID does not exist" containerID="00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878"
Jul 16 13:13:37.664098 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.664060    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878"} err="failed to get container status \"00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878\": rpc error: code = NotFound desc = could not find container \"00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878\": container with ID starting with 00778ef58ab77d1ea659c115c92daf9bef3ca2a0c6761ada8bce83457a714878 not found: ID does not exist"
Jul 16 13:13:37.671454 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.671434    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"]
Jul 16 13:13:37.677090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.677071    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0428f520-openshift-default-6b448df745-xmn5q"]
Jul 16 13:13:37.996526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.996421    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"]
Jul 16 13:13:37.996805 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.996792    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy"
Jul 16 13:13:37.996848 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.996805    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy"
Jul 16 13:13:37.996848 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.996814    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy"
Jul 16 13:13:37.996848 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.996820    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy"
Jul 16 13:13:37.996939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:37.996899    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy"
Jul 16 13:13:38.001392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.001372    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"
Jul 16 13:13:38.004048 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.004026    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:13:38.010307 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.010282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"]
Jul 16 13:13:38.101461 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.101428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb\" (UID: \"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"
Jul 16 13:13:38.202501 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.202426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb\" (UID: \"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"
Jul 16 13:13:38.203039 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.203018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb\" (UID: \"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"
Jul 16 13:13:38.313222 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.313098    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"
Jul 16 13:13:38.465563 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.465536    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"]
Jul 16 13:13:38.468219 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:13:38.468190    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3fc89e_ee94_4595_8c2e_f06a6c81c6dc.slice/crio-cc6cc4d51a371814e13c26c89bb64ac57e8caa83781da3c1399b6183e215f558 WatchSource:0}: Error finding container cc6cc4d51a371814e13c26c89bb64ac57e8caa83781da3c1399b6183e215f558: Status 404 returned error can't find the container with id cc6cc4d51a371814e13c26c89bb64ac57e8caa83781da3c1399b6183e215f558
Jul 16 13:13:38.531631 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.531595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:38.646633 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.646571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:38.652899 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.652859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb" event={"ID":"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc","Type":"ContainerStarted","Data":"cc6cc4d51a371814e13c26c89bb64ac57e8caa83781da3c1399b6183e215f558"}
Jul 16 13:13:38.834789 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:38.834703    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" path="/var/lib/kubelet/pods/370fa824-70c7-42b7-b80c-c1d4ef682f6e/volumes"
Jul 16 13:13:39.659882 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:39.659846    2564 generic.go:356] "Generic (PLEG): container finished" podID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerID="6a23a9d009ac168f18613bf476451ce95aef2f10e4ca688b35859d75f605f06e" exitCode=7
Jul 16 13:13:39.660360 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:39.659937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb" event={"ID":"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc","Type":"ContainerDied","Data":"6a23a9d009ac168f18613bf476451ce95aef2f10e4ca688b35859d75f605f06e"}
Jul 16 13:13:39.660360 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:39.660173    2564 scope.go:117] "RemoveContainer" containerID="6a23a9d009ac168f18613bf476451ce95aef2f10e4ca688b35859d75f605f06e"
Jul 16 13:13:40.673458 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:40.673424    2564 generic.go:356] "Generic (PLEG): container finished" podID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerID="033a2c57fbea704179110493846a0c003224303b6da05cdf96d217029f36b1ed" exitCode=7
Jul 16 13:13:40.673855 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:40.673511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb" event={"ID":"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc","Type":"ContainerDied","Data":"033a2c57fbea704179110493846a0c003224303b6da05cdf96d217029f36b1ed"}
Jul 16 13:13:40.673855 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:40.673590    2564 scope.go:117] "RemoveContainer" containerID="6a23a9d009ac168f18613bf476451ce95aef2f10e4ca688b35859d75f605f06e"
Jul 16 13:13:40.673855 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:40.673747    2564 scope.go:117] "RemoveContainer" containerID="033a2c57fbea704179110493846a0c003224303b6da05cdf96d217029f36b1ed"
Jul 16 13:13:40.674001 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:13:40.673951    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb_odh-ai-gateway-infra(5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc"
Jul 16 13:13:41.679787 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:41.679761    2564 scope.go:117] "RemoveContainer" containerID="033a2c57fbea704179110493846a0c003224303b6da05cdf96d217029f36b1ed"
Jul 16 13:13:41.680197 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:13:41.679948    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb_odh-ai-gateway-infra(5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc"
Jul 16 13:13:42.118049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:42.118011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:42.657216 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:42.657191    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:13:46.705729 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:46.705695    2564 generic.go:356] "Generic (PLEG): container finished" podID="3488aa54-f855-4999-82e5-721545677aef" containerID="69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36" exitCode=0
Jul 16 13:13:46.706192 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:46.705764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" event={"ID":"3488aa54-f855-4999-82e5-721545677aef","Type":"ContainerDied","Data":"69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36"}
Jul 16 13:13:46.706252 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:46.706195    2564 scope.go:117] "RemoveContainer" containerID="69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36"
Jul 16 13:13:46.707294 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:46.707260    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:13:46.707414 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:46.707332    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:13:46.707414 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:46.707365    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:13:47.712193 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:47.712162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" event={"ID":"3488aa54-f855-4999-82e5-721545677aef","Type":"ContainerStarted","Data":"f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2"}
Jul 16 13:13:48.477470 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:48.477425    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:48.478589 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:48.478566    2564 patch_prober.go:28] interesting pod/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 16 13:13:48.478654 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:48.478620    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 16 13:13:49.020364 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:49.020332    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:49.120619 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:49.120586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:13:49.478075 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:49.478029    2564 patch_prober.go:28] interesting pod/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 16 13:13:49.478290 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:49.478094    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 16 13:13:49.625657 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:49.625609    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:50.478021 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:50.477989    2564 patch_prober.go:28] interesting pod/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 16 13:13:50.478422 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:50.478046    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 16 13:13:51.477845 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:51.477808    2564 patch_prober.go:28] interesting pod/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 16 13:13:51.478031 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:51.477866    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 16 13:13:52.481609 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:52.481578    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:52.482635 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:52.482613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:13:55.828581 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:55.828547    2564 scope.go:117] "RemoveContainer" containerID="033a2c57fbea704179110493846a0c003224303b6da05cdf96d217029f36b1ed"
Jul 16 13:13:56.762380 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:56.762346    2564 generic.go:356] "Generic (PLEG): container finished" podID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerID="41c458fc0b48a90604849f049e35ecf5b89a83eb83d5ff140837b7bbc406a5a3" exitCode=0
Jul 16 13:13:56.762553 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:56.762412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb" event={"ID":"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc","Type":"ContainerDied","Data":"41c458fc0b48a90604849f049e35ecf5b89a83eb83d5ff140837b7bbc406a5a3"}
Jul 16 13:13:56.762553 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:56.762460    2564 scope.go:117] "RemoveContainer" containerID="033a2c57fbea704179110493846a0c003224303b6da05cdf96d217029f36b1ed"
Jul 16 13:13:57.801950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:57.801915    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"]
Jul 16 13:13:57.906701 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:57.906675    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"
Jul 16 13:13:57.988510 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:57.988479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc-maas-api-service-ca\") pod \"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc\" (UID: \"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc\") "
Jul 16 13:13:57.988853 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:57.988832    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" (UID: "5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:13:58.089888 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:58.089860    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:13:58.774565 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:58.774532    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"
Jul 16 13:13:58.774743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:58.774585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb" event={"ID":"5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc","Type":"ContainerDied","Data":"cc6cc4d51a371814e13c26c89bb64ac57e8caa83781da3c1399b6183e215f558"}
Jul 16 13:13:58.774743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:58.774637    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc6cc4d51a371814e13c26c89bb64ac57e8caa83781da3c1399b6183e215f558"
Jul 16 13:13:58.827779 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:58.827747    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"]
Jul 16 13:13:58.835475 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:13:58.835445    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-kgstb"]
Jul 16 13:14:00.833725 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:00.833692    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" path="/var/lib/kubelet/pods/5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc/volumes"
Jul 16 13:14:35.516853 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:35.516792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:35.615229 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:35.615191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:38.118861 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.118822    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"]
Jul 16 13:14:38.119392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.119249    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:38.119392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.119265    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:38.119392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.119284    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:38.119392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.119289    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:38.119392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.119362    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:38.119392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.119371    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:38.119392 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.119380    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="370fa824-70c7-42b7-b80c-c1d4ef682f6e" containerName="istio-proxy"
Jul 16 13:14:38.122691 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.122666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"
Jul 16 13:14:38.125406 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.125378    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:14:38.131745 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.131720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"]
Jul 16 13:14:38.137380 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.137344    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"]
Jul 16 13:14:38.137575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.137549    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy" containerID="cri-o://f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2" gracePeriod=30
Jul 16 13:14:38.147996 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.147969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8\" (UID: \"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"
Jul 16 13:14:38.156935 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.156908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:38.249452 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.249412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8\" (UID: \"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"
Jul 16 13:14:38.250055 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.250034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8\" (UID: \"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"
Jul 16 13:14:38.291649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.291611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:38.435796 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.435692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"
Jul 16 13:14:38.578597 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.578566    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"]
Jul 16 13:14:38.580652 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:14:38.580623    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b2b2ba_e211_47f0_b4ca_f16b9eb188dc.slice/crio-a727dbccd7ef1cee9ffa74b252038d9a4b365d8b1d453370cdb8f9bcc30a2e4f WatchSource:0}: Error finding container a727dbccd7ef1cee9ffa74b252038d9a4b365d8b1d453370cdb8f9bcc30a2e4f: Status 404 returned error can't find the container with id a727dbccd7ef1cee9ffa74b252038d9a4b365d8b1d453370cdb8f9bcc30a2e4f
Jul 16 13:14:38.726573 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.726467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:38.827802 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.827774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:38.970933 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.970897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8" event={"ID":"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc","Type":"ContainerStarted","Data":"e758ac591958cea0f7b1e0eabb533dd5b4d06f3da5c8f6843296452234dd8402"}
Jul 16 13:14:38.971190 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.970958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8" event={"ID":"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc","Type":"ContainerStarted","Data":"a727dbccd7ef1cee9ffa74b252038d9a4b365d8b1d453370cdb8f9bcc30a2e4f"}
Jul 16 13:14:38.994933 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:38.994835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8" podStartSLOduration=0.994819718 podStartE2EDuration="994.819718ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:14:38.990819097 +0000 UTC m=+1762.729808875" watchObservedRunningTime="2026-07-16 13:14:38.994819718 +0000 UTC m=+1762.733809497"
Jul 16 13:14:39.978160 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:39.978103    2564 generic.go:356] "Generic (PLEG): container finished" podID="f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc" containerID="e758ac591958cea0f7b1e0eabb533dd5b4d06f3da5c8f6843296452234dd8402" exitCode=0
Jul 16 13:14:39.978600 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:39.978168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8" event={"ID":"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc","Type":"ContainerDied","Data":"e758ac591958cea0f7b1e0eabb533dd5b4d06f3da5c8f6843296452234dd8402"}
Jul 16 13:14:41.117090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:41.117062    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"
Jul 16 13:14:41.176893 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:41.176863    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc-maas-api-service-ca\") pod \"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc\" (UID: \"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc\") "
Jul 16 13:14:41.177250 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:41.177229    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc" (UID: "f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:14:41.278546 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:41.278452    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:41.989357 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:41.989326    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8"
Jul 16 13:14:41.989357 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:41.989352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8" event={"ID":"f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc","Type":"ContainerDied","Data":"a727dbccd7ef1cee9ffa74b252038d9a4b365d8b1d453370cdb8f9bcc30a2e4f"}
Jul 16 13:14:41.989623 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:41.989401    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a727dbccd7ef1cee9ffa74b252038d9a4b365d8b1d453370cdb8f9bcc30a2e4f"
Jul 16 13:14:43.391305 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.391280    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:14:43.497954 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.497921    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3488aa54-f855-4999-82e5-721545677aef-istio-podinfo\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498134 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.497971    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3488aa54-f855-4999-82e5-721545677aef-istiod-ca-cert\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498134 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-credential-socket\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498224 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498130    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-socket\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498224 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-istio-token\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498224 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498216    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mljl\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-kube-api-access-5mljl\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498247    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-envoy\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498294    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-data\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498344    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-certs\") pod \"3488aa54-f855-4999-82e5-721545677aef\" (UID: \"3488aa54-f855-4999-82e5-721545677aef\") "
Jul 16 13:14:43.498383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498345    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:14:43.498583 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498383    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:14:43.498583 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3488aa54-f855-4999-82e5-721545677aef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:14:43.498696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498648    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3488aa54-f855-4999-82e5-721545677aef-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.498696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498675    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.498696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498680    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:14:43.498696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.498693    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.499281 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.499255    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-data" (OuterVolumeSpecName: "istio-data") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:14:43.500591 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.500563    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-istio-token" (OuterVolumeSpecName: "istio-token") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:14:43.500712 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.500606    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3488aa54-f855-4999-82e5-721545677aef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:14:43.500830 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.500797    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:14:43.500885 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.500864    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-kube-api-access-5mljl" (OuterVolumeSpecName: "kube-api-access-5mljl") pod "3488aa54-f855-4999-82e5-721545677aef" (UID: "3488aa54-f855-4999-82e5-721545677aef"). InnerVolumeSpecName "kube-api-access-5mljl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:14:43.599165 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.599100    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.599165 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.599159    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mljl\" (UniqueName: \"kubernetes.io/projected/3488aa54-f855-4999-82e5-721545677aef-kube-api-access-5mljl\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.599165 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.599170    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.599165 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.599178    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.599434 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.599187    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3488aa54-f855-4999-82e5-721545677aef-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:43.599434 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:43.599195    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3488aa54-f855-4999-82e5-721545677aef-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:44.000783 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.000744    2564 generic.go:356] "Generic (PLEG): container finished" podID="3488aa54-f855-4999-82e5-721545677aef" containerID="f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2" exitCode=0
Jul 16 13:14:44.000939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.000799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" event={"ID":"3488aa54-f855-4999-82e5-721545677aef","Type":"ContainerDied","Data":"f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2"}
Jul 16 13:14:44.000939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.000815    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"
Jul 16 13:14:44.000939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.000854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5" event={"ID":"3488aa54-f855-4999-82e5-721545677aef","Type":"ContainerDied","Data":"8e27bb9fa969e6facc8111e74bedc0fa090d36bdcfbe674e0f773882e491c903"}
Jul 16 13:14:44.000939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.000884    2564 scope.go:117] "RemoveContainer" containerID="f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2"
Jul 16 13:14:44.010368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.010349    2564 scope.go:117] "RemoveContainer" containerID="69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36"
Jul 16 13:14:44.018499 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.018477    2564 scope.go:117] "RemoveContainer" containerID="f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2"
Jul 16 13:14:44.018787 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:14:44.018764    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2\": container with ID starting with f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2 not found: ID does not exist" containerID="f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2"
Jul 16 13:14:44.018835 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.018797    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2"} err="failed to get container status \"f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2\": rpc error: code = NotFound desc = could not find container \"f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2\": container with ID starting with f771ded3376bb2a59774d2c0fa5b2eda5e6c1160903d34adb463c9dd2405eaf2 not found: ID does not exist"
Jul 16 13:14:44.018835 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.018816    2564 scope.go:117] "RemoveContainer" containerID="69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36"
Jul 16 13:14:44.019070 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:14:44.019050    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36\": container with ID starting with 69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36 not found: ID does not exist" containerID="69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36"
Jul 16 13:14:44.019148 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.019075    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36"} err="failed to get container status \"69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36\": rpc error: code = NotFound desc = could not find container \"69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36\": container with ID starting with 69ee678e6e471fa5fffb67bfc080f23f0f0cf1a407e123196be32422626f7d36 not found: ID does not exist"
Jul 16 13:14:44.028687 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.028651    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"]
Jul 16 13:14:44.041588 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.041551    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f8d4b9eb-gw-openshift-default-7887cff97f-2h8x5"]
Jul 16 13:14:44.785584 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.785555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:44.834982 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:44.834949    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3488aa54-f855-4999-82e5-721545677aef" path="/var/lib/kubelet/pods/3488aa54-f855-4999-82e5-721545677aef/volumes"
Jul 16 13:14:45.892819 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:45.892786    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"]
Jul 16 13:14:45.893313 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:45.893037    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl" podUID="92df48a4-6587-4359-b89b-43dc404f1dfd" containerName="maas-api" containerID="cri-o://19d8af1ab94fb79c864923fbb671a19b760675814607b33cbee6809860fa9530" gracePeriod=30
Jul 16 13:14:45.930751 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:45.930711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:46.016302 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.016273    2564 generic.go:356] "Generic (PLEG): container finished" podID="92df48a4-6587-4359-b89b-43dc404f1dfd" containerID="19d8af1ab94fb79c864923fbb671a19b760675814607b33cbee6809860fa9530" exitCode=0
Jul 16 13:14:46.016453 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.016364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl" event={"ID":"92df48a4-6587-4359-b89b-43dc404f1dfd","Type":"ContainerDied","Data":"19d8af1ab94fb79c864923fbb671a19b760675814607b33cbee6809860fa9530"}
Jul 16 13:14:46.078300 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.078270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:46.150006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.149941    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:14:46.160401 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.160374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:46.222681 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.222643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rlcm\" (UniqueName: \"kubernetes.io/projected/92df48a4-6587-4359-b89b-43dc404f1dfd-kube-api-access-5rlcm\") pod \"92df48a4-6587-4359-b89b-43dc404f1dfd\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") "
Jul 16 13:14:46.222681 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.222686    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92df48a4-6587-4359-b89b-43dc404f1dfd-openshift-service-ca\") pod \"92df48a4-6587-4359-b89b-43dc404f1dfd\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") "
Jul 16 13:14:46.222917 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.222720    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92df48a4-6587-4359-b89b-43dc404f1dfd-maas-api-tls\") pod \"92df48a4-6587-4359-b89b-43dc404f1dfd\" (UID: \"92df48a4-6587-4359-b89b-43dc404f1dfd\") "
Jul 16 13:14:46.223074 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.223048    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92df48a4-6587-4359-b89b-43dc404f1dfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "92df48a4-6587-4359-b89b-43dc404f1dfd" (UID: "92df48a4-6587-4359-b89b-43dc404f1dfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:14:46.224808 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.224780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92df48a4-6587-4359-b89b-43dc404f1dfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "92df48a4-6587-4359-b89b-43dc404f1dfd" (UID: "92df48a4-6587-4359-b89b-43dc404f1dfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:14:46.224808 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.224786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92df48a4-6587-4359-b89b-43dc404f1dfd-kube-api-access-5rlcm" (OuterVolumeSpecName: "kube-api-access-5rlcm") pod "92df48a4-6587-4359-b89b-43dc404f1dfd" (UID: "92df48a4-6587-4359-b89b-43dc404f1dfd"). InnerVolumeSpecName "kube-api-access-5rlcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:14:46.323570 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.323497    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rlcm\" (UniqueName: \"kubernetes.io/projected/92df48a4-6587-4359-b89b-43dc404f1dfd-kube-api-access-5rlcm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:46.323570 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.323529    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92df48a4-6587-4359-b89b-43dc404f1dfd-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:46.323570 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.323543    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92df48a4-6587-4359-b89b-43dc404f1dfd-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:14:46.338451 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338414    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"]
Jul 16 13:14:46.338796 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338782    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy"
Jul 16 13:14:46.338843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338799    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy"
Jul 16 13:14:46.338843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338813    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:46.338843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338822    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:46.338843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338829    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92df48a4-6587-4359-b89b-43dc404f1dfd" containerName="maas-api"
Jul 16 13:14:46.338843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338834    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92df48a4-6587-4359-b89b-43dc404f1dfd" containerName="maas-api"
Jul 16 13:14:46.338843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338843    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338848    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338868    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc" containerName="revoke-keys"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338876    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc" containerName="revoke-keys"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338934    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc" containerName="revoke-keys"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338941    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338947    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="92df48a4-6587-4359-b89b-43dc404f1dfd" containerName="maas-api"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338954    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3488aa54-f855-4999-82e5-721545677aef" containerName="istio-proxy"
Jul 16 13:14:46.339086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.338960    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3fc89e-ee94-4595-8c2e-f06a6c81c6dc" containerName="revoke-keys"
Jul 16 13:14:46.342376 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.342346    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.345936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.345914    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-77899ed4-openshift-default-dockercfg-qlj9b\""
Jul 16 13:14:46.361777 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.361752    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"]
Jul 16 13:14:46.424844 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.424738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-token\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425029 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.424859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-certs\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425029 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.424912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-envoy\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425029 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.424935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-podinfo\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425029 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.424959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istiod-ca-cert\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425029 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.424982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb9zv\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-kube-api-access-nb9zv\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425331 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.425083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-credential-socket\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425331 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.425140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-data\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.425331 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.425171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-socket\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526314 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-credential-socket\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526314 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-data\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-socket\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-token\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-certs\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-envoy\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-podinfo\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istiod-ca-cert\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9zv\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-kube-api-access-nb9zv\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.526940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.526785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-data\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.527204 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.527169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-credential-socket\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.527300 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.527228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-certs\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.527362 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.527353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istiod-ca-cert\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.527418 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.527382    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-socket\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.528962 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.528939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-podinfo\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.529149 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.529130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-envoy\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.536923 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.536887    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-token\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.537186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.537167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb9zv\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-kube-api-access-nb9zv\") pod \"e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") " pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.654446 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.654401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:46.796773 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.796748    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"]
Jul 16 13:14:46.798968 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:14:46.798937    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11d4fb1_cf23_4b41_af89_1ae4f14fb165.slice/crio-a7d15cc8354cccf70ecbd9556a96cbf7139489f4440ac1360a803fb1d299369a WatchSource:0}: Error finding container a7d15cc8354cccf70ecbd9556a96cbf7139489f4440ac1360a803fb1d299369a: Status 404 returned error can't find the container with id a7d15cc8354cccf70ecbd9556a96cbf7139489f4440ac1360a803fb1d299369a
Jul 16 13:14:46.801038 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.801002    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:14:46.801135 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.801074    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:14:46.801135 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:46.801100    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:14:47.031569 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.031028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" event={"ID":"d11d4fb1-cf23-4b41-af89-1ae4f14fb165","Type":"ContainerStarted","Data":"2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc"}
Jul 16 13:14:47.031569 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.031154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" event={"ID":"d11d4fb1-cf23-4b41-af89-1ae4f14fb165","Type":"ContainerStarted","Data":"a7d15cc8354cccf70ecbd9556a96cbf7139489f4440ac1360a803fb1d299369a"}
Jul 16 13:14:47.033862 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.033833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl" event={"ID":"92df48a4-6587-4359-b89b-43dc404f1dfd","Type":"ContainerDied","Data":"72e9db5fdc169c26772248e5fed8d0adca488c10d1222143e753917839b65054"}
Jul 16 13:14:47.034034 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.033893    2564 scope.go:117] "RemoveContainer" containerID="19d8af1ab94fb79c864923fbb671a19b760675814607b33cbee6809860fa9530"
Jul 16 13:14:47.034034 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.034023    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"
Jul 16 13:14:47.060024 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.059972    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podStartSLOduration=1.05995481 podStartE2EDuration="1.05995481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:14:47.058730441 +0000 UTC m=+1770.797720220" watchObservedRunningTime="2026-07-16 13:14:47.05995481 +0000 UTC m=+1770.798944590"
Jul 16 13:14:47.076054 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.076017    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"]
Jul 16 13:14:47.081939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.081910    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f8d4b9eb-cf4cfbf7f-779tl"]
Jul 16 13:14:47.521832 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.521779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:47.626167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.626126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:47.655268 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.655237    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:47.660162 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.660135    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:47.729796 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.729762    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"]
Jul 16 13:14:47.730946 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.730919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:47.735177 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.735156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.738049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.738022    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-77899ed4-serving-cert\""
Jul 16 13:14:47.745051 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.745027    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"]
Jul 16 13:14:47.821530 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.821436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:47.837587 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.837552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69d470c-65ba-4139-a609-f483f695d0cd-openshift-service-ca\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.837756 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.837658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjdr4\" (UniqueName: \"kubernetes.io/projected/b69d470c-65ba-4139-a609-f483f695d0cd-kube-api-access-cjdr4\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.837756 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.837737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.939012 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.938970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.939211 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.939161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69d470c-65ba-4139-a609-f483f695d0cd-openshift-service-ca\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.939211 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:14:47.939177    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-serving-cert: secret "maas-api-e2e-ait-77899ed4-serving-cert" not found
Jul 16 13:14:47.939294 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:14:47.939246    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls podName:b69d470c-65ba-4139-a609-f483f695d0cd nodeName:}" failed. No retries permitted until 2026-07-16 13:14:48.43922888 +0000 UTC m=+1772.178218636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls") pod "maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc" (UID: "b69d470c-65ba-4139-a609-f483f695d0cd") : secret "maas-api-e2e-ait-77899ed4-serving-cert" not found
Jul 16 13:14:47.939294 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.939264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjdr4\" (UniqueName: \"kubernetes.io/projected/b69d470c-65ba-4139-a609-f483f695d0cd-kube-api-access-cjdr4\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.939772 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.939754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69d470c-65ba-4139-a609-f483f695d0cd-openshift-service-ca\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:47.996132 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:47.996082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjdr4\" (UniqueName: \"kubernetes.io/projected/b69d470c-65ba-4139-a609-f483f695d0cd-kube-api-access-cjdr4\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:48.030206 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.030168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:48.040042 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.040003    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:48.041312 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.041289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:14:48.443593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.443498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:48.445987 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.445958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls\") pod \"maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:48.496253 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.496201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:48.605161 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.605128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:48.647336 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.647300    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:48.797651 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.797626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"]
Jul 16 13:14:48.799323 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:14:48.799293    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69d470c_65ba_4139_a609_f483f695d0cd.slice/crio-16452166f79eb2082087ec47699e1da904217dfef157c54f09c2ae39885b8fac WatchSource:0}: Error finding container 16452166f79eb2082087ec47699e1da904217dfef157c54f09c2ae39885b8fac: Status 404 returned error can't find the container with id 16452166f79eb2082087ec47699e1da904217dfef157c54f09c2ae39885b8fac
Jul 16 13:14:48.836432 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:48.836387    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92df48a4-6587-4359-b89b-43dc404f1dfd" path="/var/lib/kubelet/pods/92df48a4-6587-4359-b89b-43dc404f1dfd/volumes"
Jul 16 13:14:49.045791 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:49.045705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc" event={"ID":"b69d470c-65ba-4139-a609-f483f695d0cd","Type":"ContainerStarted","Data":"16452166f79eb2082087ec47699e1da904217dfef157c54f09c2ae39885b8fac"}
Jul 16 13:14:49.782202 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:49.782170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:14:50.052503 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:50.052397    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc" event={"ID":"b69d470c-65ba-4139-a609-f483f695d0cd","Type":"ContainerStarted","Data":"835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26"}
Jul 16 13:14:50.052877 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:50.052611    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:50.081670 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:50.081606    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc" podStartSLOduration=2.642975561 podStartE2EDuration="3.081584918s" totalImagesPullingTime="438.609357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:14:50.081406751 +0000 UTC m=+1773.820396530" watchObservedRunningTime="2026-07-16 13:14:50.081584918 +0000 UTC m=+1773.820574698"
Jul 16 13:14:52.809924 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:52.809881    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"]
Jul 16 13:14:52.813474 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:52.813447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"
Jul 16 13:14:52.816353 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:52.816329    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:14:52.827745 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:52.827709    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"]
Jul 16 13:14:52.883930 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:52.883886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1d01b9-d147-4b88-91ab-ffb991822db5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx\" (UID: \"4a1d01b9-d147-4b88-91ab-ffb991822db5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"
Jul 16 13:14:52.984938 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:52.984899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1d01b9-d147-4b88-91ab-ffb991822db5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx\" (UID: \"4a1d01b9-d147-4b88-91ab-ffb991822db5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"
Jul 16 13:14:52.985552 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:52.985530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1d01b9-d147-4b88-91ab-ffb991822db5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx\" (UID: \"4a1d01b9-d147-4b88-91ab-ffb991822db5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"
Jul 16 13:14:53.124168 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:53.124128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"
Jul 16 13:14:53.284569 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:53.284503    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"]
Jul 16 13:14:53.285948 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:14:53.285917    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1d01b9_d147_4b88_91ab_ffb991822db5.slice/crio-6788419976d8354f597abf4556f1b8a406a476b05f03deb6fd49e48190cf0db4 WatchSource:0}: Error finding container 6788419976d8354f597abf4556f1b8a406a476b05f03deb6fd49e48190cf0db4: Status 404 returned error can't find the container with id 6788419976d8354f597abf4556f1b8a406a476b05f03deb6fd49e48190cf0db4
Jul 16 13:14:54.079988 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:54.079951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" event={"ID":"4a1d01b9-d147-4b88-91ab-ffb991822db5","Type":"ContainerStarted","Data":"1e7a0781b3dde852adc562090a2dac94c4949d61b444650c60d4d6125ea0e38f"}
Jul 16 13:14:54.080509 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:54.080011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" event={"ID":"4a1d01b9-d147-4b88-91ab-ffb991822db5","Type":"ContainerStarted","Data":"6788419976d8354f597abf4556f1b8a406a476b05f03deb6fd49e48190cf0db4"}
Jul 16 13:14:54.102116 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:54.102056    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" podStartSLOduration=2.102040179 podStartE2EDuration="2.102040179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:14:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:14:54.100354598 +0000 UTC m=+1777.839344399" watchObservedRunningTime="2026-07-16 13:14:54.102040179 +0000 UTC m=+1777.841029958"
Jul 16 13:14:55.085909 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:55.085874    2564 generic.go:356] "Generic (PLEG): container finished" podID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerID="1e7a0781b3dde852adc562090a2dac94c4949d61b444650c60d4d6125ea0e38f" exitCode=7
Jul 16 13:14:55.086368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:55.085968    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" event={"ID":"4a1d01b9-d147-4b88-91ab-ffb991822db5","Type":"ContainerDied","Data":"1e7a0781b3dde852adc562090a2dac94c4949d61b444650c60d4d6125ea0e38f"}
Jul 16 13:14:55.086368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:55.086135    2564 scope.go:117] "RemoveContainer" containerID="1e7a0781b3dde852adc562090a2dac94c4949d61b444650c60d4d6125ea0e38f"
Jul 16 13:14:56.069634 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:56.069544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:14:56.092926 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:56.092893    2564 generic.go:356] "Generic (PLEG): container finished" podID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerID="791c98f2e1ff7670e3f3a435d1ad78614cdc04cc7666c16f305e71b1b6ff92a8" exitCode=7
Jul 16 13:14:56.093412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:56.092984    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" event={"ID":"4a1d01b9-d147-4b88-91ab-ffb991822db5","Type":"ContainerDied","Data":"791c98f2e1ff7670e3f3a435d1ad78614cdc04cc7666c16f305e71b1b6ff92a8"}
Jul 16 13:14:56.093412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:56.093041    2564 scope.go:117] "RemoveContainer" containerID="1e7a0781b3dde852adc562090a2dac94c4949d61b444650c60d4d6125ea0e38f"
Jul 16 13:14:56.093412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:56.093203    2564 scope.go:117] "RemoveContainer" containerID="791c98f2e1ff7670e3f3a435d1ad78614cdc04cc7666c16f305e71b1b6ff92a8"
Jul 16 13:14:56.093570 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:14:56.093416    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx_odh-ai-gateway-infra(4a1d01b9-d147-4b88-91ab-ffb991822db5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5"
Jul 16 13:14:57.099403 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:14:57.099378    2564 scope.go:117] "RemoveContainer" containerID="791c98f2e1ff7670e3f3a435d1ad78614cdc04cc7666c16f305e71b1b6ff92a8"
Jul 16 13:14:57.099802 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:14:57.099553    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx_odh-ai-gateway-infra(4a1d01b9-d147-4b88-91ab-ffb991822db5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5"
Jul 16 13:15:00.156436 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.156402    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8"]
Jul 16 13:15:00.161157 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.161137    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"]
Jul 16 13:15:00.161267 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.161223    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8"
Jul 16 13:15:00.170097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.169415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"
Jul 16 13:15:00.178077 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.178057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8"
Jul 16 13:15:00.185403 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.185377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"
Jul 16 13:15:00.186314 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.186290    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8"]
Jul 16 13:15:00.189990 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.189965    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"]
Jul 16 13:15:00.379943 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.379917    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"]
Jul 16 13:15:00.382222 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:15:00.382182    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d5c726_0ef4_4244_9834_7572ee5dc6da.slice/crio-22b3b58141bd8e6fbfdf48857e7f8194cfb2becaab89ba6f762e872dee798a18 WatchSource:0}: Error finding container 22b3b58141bd8e6fbfdf48857e7f8194cfb2becaab89ba6f762e872dee798a18: Status 404 returned error can't find the container with id 22b3b58141bd8e6fbfdf48857e7f8194cfb2becaab89ba6f762e872dee798a18
Jul 16 13:15:00.575665 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:00.575643    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8"]
Jul 16 13:15:00.578231 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:15:00.578201    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae8292f_01d9_41f5_9e45_ca72d878104a.slice/crio-37684d2905142c4485c13bc5154135d5a9303fb380420167c9de271888f7089a WatchSource:0}: Error finding container 37684d2905142c4485c13bc5154135d5a9303fb380420167c9de271888f7089a: Status 404 returned error can't find the container with id 37684d2905142c4485c13bc5154135d5a9303fb380420167c9de271888f7089a
Jul 16 13:15:01.126568 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:01.126499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv" event={"ID":"70d5c726-0ef4-4244-9834-7572ee5dc6da","Type":"ContainerStarted","Data":"0b31b4d655127bbe2afc1383d565cfbae5a4c14e7938494b808095effb0bd838"}
Jul 16 13:15:01.127008 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:01.126806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv" event={"ID":"70d5c726-0ef4-4244-9834-7572ee5dc6da","Type":"ContainerStarted","Data":"22b3b58141bd8e6fbfdf48857e7f8194cfb2becaab89ba6f762e872dee798a18"}
Jul 16 13:15:01.129133 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:01.129089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8" event={"ID":"8ae8292f-01d9-41f5-9e45-ca72d878104a","Type":"ContainerStarted","Data":"c4d64171e94de4bc046c4ef5c98cc447b4cc12e115cb2739fb86a2c5b1b063f2"}
Jul 16 13:15:01.129258 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:01.129164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8" event={"ID":"8ae8292f-01d9-41f5-9e45-ca72d878104a","Type":"ContainerStarted","Data":"37684d2905142c4485c13bc5154135d5a9303fb380420167c9de271888f7089a"}
Jul 16 13:15:01.149609 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:01.149558    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv" podStartSLOduration=1.149544001 podStartE2EDuration="1.149544001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:15:01.146894333 +0000 UTC m=+1784.885884111" watchObservedRunningTime="2026-07-16 13:15:01.149544001 +0000 UTC m=+1784.888533813"
Jul 16 13:15:01.171589 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:01.171536    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8" podStartSLOduration=1.171517557 podStartE2EDuration="1.171517557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:15:01.169463913 +0000 UTC m=+1784.908453693" watchObservedRunningTime="2026-07-16 13:15:01.171517557 +0000 UTC m=+1784.910507336"
Jul 16 13:15:02.137562 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:02.137525    2564 generic.go:356] "Generic (PLEG): container finished" podID="70d5c726-0ef4-4244-9834-7572ee5dc6da" containerID="0b31b4d655127bbe2afc1383d565cfbae5a4c14e7938494b808095effb0bd838" exitCode=0
Jul 16 13:15:02.137753 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:02.137602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv" event={"ID":"70d5c726-0ef4-4244-9834-7572ee5dc6da","Type":"ContainerDied","Data":"0b31b4d655127bbe2afc1383d565cfbae5a4c14e7938494b808095effb0bd838"}
Jul 16 13:15:02.139276 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:02.139251    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ae8292f-01d9-41f5-9e45-ca72d878104a" containerID="c4d64171e94de4bc046c4ef5c98cc447b4cc12e115cb2739fb86a2c5b1b063f2" exitCode=0
Jul 16 13:15:02.139412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:02.139289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8" event={"ID":"8ae8292f-01d9-41f5-9e45-ca72d878104a","Type":"ContainerDied","Data":"c4d64171e94de4bc046c4ef5c98cc447b4cc12e115cb2739fb86a2c5b1b063f2"}
Jul 16 13:15:03.041792 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.041756    2564 patch_prober.go:28] interesting pod/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 16 13:15:03.042173 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.041822    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 16 13:15:03.145532 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.145500    2564 generic.go:356] "Generic (PLEG): container finished" podID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerID="2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc" exitCode=0
Jul 16 13:15:03.145692 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.145570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" event={"ID":"d11d4fb1-cf23-4b41-af89-1ae4f14fb165","Type":"ContainerDied","Data":"2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc"}
Jul 16 13:15:03.146503 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.146102    2564 scope.go:117] "RemoveContainer" containerID="2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc"
Jul 16 13:15:03.147221 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.147186    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:15:03.147349 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.147276    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:15:03.147349 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.147312    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:15:03.344183 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.344151    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8"
Jul 16 13:15:03.346772 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:03.346743    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"
Jul 16 13:15:04.158339 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.158308    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"
Jul 16 13:15:04.158759 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.158338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv" event={"ID":"70d5c726-0ef4-4244-9834-7572ee5dc6da","Type":"ContainerDied","Data":"22b3b58141bd8e6fbfdf48857e7f8194cfb2becaab89ba6f762e872dee798a18"}
Jul 16 13:15:04.158759 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.158424    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22b3b58141bd8e6fbfdf48857e7f8194cfb2becaab89ba6f762e872dee798a18"
Jul 16 13:15:04.160282 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.160248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" event={"ID":"d11d4fb1-cf23-4b41-af89-1ae4f14fb165","Type":"ContainerStarted","Data":"3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd"}
Jul 16 13:15:04.161503 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.161480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8" event={"ID":"8ae8292f-01d9-41f5-9e45-ca72d878104a","Type":"ContainerDied","Data":"37684d2905142c4485c13bc5154135d5a9303fb380420167c9de271888f7089a"}
Jul 16 13:15:04.161620 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.161514    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37684d2905142c4485c13bc5154135d5a9303fb380420167c9de271888f7089a"
Jul 16 13:15:04.161620 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.161513    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-z46g8"
Jul 16 13:15:04.654695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.654653    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:15:04.654894 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.654872    2564 patch_prober.go:28] interesting pod/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 16 13:15:04.654941 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:04.654922    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 16 13:15:05.655382 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:05.655339    2564 patch_prober.go:28] interesting pod/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 16 13:15:05.655895 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:05.655408    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 16 13:15:06.655678 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:06.655635    2564 patch_prober.go:28] interesting pod/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 16 13:15:06.656097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:06.655692    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 16 13:15:07.655378 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:07.655342    2564 patch_prober.go:28] interesting pod/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 16 13:15:07.655575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:07.655399    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 16 13:15:08.659316 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:08.659240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:15:08.659703 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:08.659512    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:15:08.660299 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:08.660275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:15:12.828024 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:12.827991    2564 scope.go:117] "RemoveContainer" containerID="791c98f2e1ff7670e3f3a435d1ad78614cdc04cc7666c16f305e71b1b6ff92a8"
Jul 16 13:15:13.207905 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:13.207870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" event={"ID":"4a1d01b9-d147-4b88-91ab-ffb991822db5","Type":"ContainerStarted","Data":"0fb5dc254d828fcdb6a9eea7db0b8bbb61ebce0410850c1d73adede2d83b396d"}
Jul 16 13:15:14.214593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:14.214553    2564 generic.go:356] "Generic (PLEG): container finished" podID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerID="0fb5dc254d828fcdb6a9eea7db0b8bbb61ebce0410850c1d73adede2d83b396d" exitCode=0
Jul 16 13:15:14.215002 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:14.214626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" event={"ID":"4a1d01b9-d147-4b88-91ab-ffb991822db5","Type":"ContainerDied","Data":"0fb5dc254d828fcdb6a9eea7db0b8bbb61ebce0410850c1d73adede2d83b396d"}
Jul 16 13:15:14.215002 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:14.214689    2564 scope.go:117] "RemoveContainer" containerID="791c98f2e1ff7670e3f3a435d1ad78614cdc04cc7666c16f305e71b1b6ff92a8"
Jul 16 13:15:14.264996 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:14.264969    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"]
Jul 16 13:15:15.359046 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:15.359020    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"
Jul 16 13:15:15.400173 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:15.400142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1d01b9-d147-4b88-91ab-ffb991822db5-maas-api-service-ca\") pod \"4a1d01b9-d147-4b88-91ab-ffb991822db5\" (UID: \"4a1d01b9-d147-4b88-91ab-ffb991822db5\") "
Jul 16 13:15:15.400468 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:15.400445    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a1d01b9-d147-4b88-91ab-ffb991822db5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a1d01b9-d147-4b88-91ab-ffb991822db5" (UID: "4a1d01b9-d147-4b88-91ab-ffb991822db5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:15:15.501456 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:15.501356    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1d01b9-d147-4b88-91ab-ffb991822db5-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:15:16.229630 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:16.229600    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"
Jul 16 13:15:16.229630 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:16.229617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx" event={"ID":"4a1d01b9-d147-4b88-91ab-ffb991822db5","Type":"ContainerDied","Data":"6788419976d8354f597abf4556f1b8a406a476b05f03deb6fd49e48190cf0db4"}
Jul 16 13:15:16.229863 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:16.229672    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6788419976d8354f597abf4556f1b8a406a476b05f03deb6fd49e48190cf0db4"
Jul 16 13:15:16.266124 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:16.266084    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"]
Jul 16 13:15:16.272674 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:16.272649    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-fmjmx"]
Jul 16 13:15:16.835615 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:16.835581    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" path="/var/lib/kubelet/pods/4a1d01b9-d147-4b88-91ab-ffb991822db5/volumes"
Jul 16 13:15:20.783189 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:20.783152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:15:20.884094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:20.884060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:15:52.863755 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.863711    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"]
Jul 16 13:15:52.864365 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864343    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:15:52.864412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864368    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:15:52.864412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864388    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:15:52.864412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864396    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:15:52.864412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864406    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae8292f-01d9-41f5-9e45-ca72d878104a" containerName="cleanup"
Jul 16 13:15:52.864536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864414    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae8292f-01d9-41f5-9e45-ca72d878104a" containerName="cleanup"
Jul 16 13:15:52.864536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864436    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d5c726-0ef4-4244-9834-7572ee5dc6da" containerName="cleanup"
Jul 16 13:15:52.864536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864445    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d5c726-0ef4-4244-9834-7572ee5dc6da" containerName="cleanup"
Jul 16 13:15:52.864627 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864546    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:15:52.864627 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864556    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:15:52.864627 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864569    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae8292f-01d9-41f5-9e45-ca72d878104a" containerName="cleanup"
Jul 16 13:15:52.864627 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.864579    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d5c726-0ef4-4244-9834-7572ee5dc6da" containerName="cleanup"
Jul 16 13:15:52.868266 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.868247    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"
Jul 16 13:15:52.871179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.871160    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:15:52.883181 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:52.883156    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"]
Jul 16 13:15:53.032402 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:53.032363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c60f7f-9c79-47bc-8cef-8dc444e594ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-77899ed4-q89b9\" (UID: \"58c60f7f-9c79-47bc-8cef-8dc444e594ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"
Jul 16 13:15:53.133053 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:53.132957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c60f7f-9c79-47bc-8cef-8dc444e594ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-77899ed4-q89b9\" (UID: \"58c60f7f-9c79-47bc-8cef-8dc444e594ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"
Jul 16 13:15:53.133596 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:53.133575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c60f7f-9c79-47bc-8cef-8dc444e594ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-77899ed4-q89b9\" (UID: \"58c60f7f-9c79-47bc-8cef-8dc444e594ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"
Jul 16 13:15:53.181996 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:53.181965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"
Jul 16 13:15:53.322459 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:53.322433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"]
Jul 16 13:15:53.324908 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:15:53.324870    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c60f7f_9c79_47bc_8cef_8dc444e594ab.slice/crio-7b31f3f95fd217ca9d182081e88a8547ec607641c6c43fda62d20be32b32d922 WatchSource:0}: Error finding container 7b31f3f95fd217ca9d182081e88a8547ec607641c6c43fda62d20be32b32d922: Status 404 returned error can't find the container with id 7b31f3f95fd217ca9d182081e88a8547ec607641c6c43fda62d20be32b32d922
Jul 16 13:15:53.424359 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:53.424275    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9" event={"ID":"58c60f7f-9c79-47bc-8cef-8dc444e594ab","Type":"ContainerStarted","Data":"7b31f3f95fd217ca9d182081e88a8547ec607641c6c43fda62d20be32b32d922"}
Jul 16 13:15:54.431496 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:54.431464    2564 generic.go:356] "Generic (PLEG): container finished" podID="58c60f7f-9c79-47bc-8cef-8dc444e594ab" containerID="c25580c673fc0f0de139958ff21f4c5fecca0a0b7c620064e8b476ff1c2525d9" exitCode=0
Jul 16 13:15:54.431496 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:54.431501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9" event={"ID":"58c60f7f-9c79-47bc-8cef-8dc444e594ab","Type":"ContainerDied","Data":"c25580c673fc0f0de139958ff21f4c5fecca0a0b7c620064e8b476ff1c2525d9"}
Jul 16 13:15:55.575079 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:55.575054    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"
Jul 16 13:15:55.757471 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:55.757386    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c60f7f-9c79-47bc-8cef-8dc444e594ab-maas-api-service-ca\") pod \"58c60f7f-9c79-47bc-8cef-8dc444e594ab\" (UID: \"58c60f7f-9c79-47bc-8cef-8dc444e594ab\") "
Jul 16 13:15:55.757734 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:55.757710    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58c60f7f-9c79-47bc-8cef-8dc444e594ab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58c60f7f-9c79-47bc-8cef-8dc444e594ab" (UID: "58c60f7f-9c79-47bc-8cef-8dc444e594ab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:15:55.858879 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:55.858844    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c60f7f-9c79-47bc-8cef-8dc444e594ab-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:15:56.443746 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:56.443722    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9"
Jul 16 13:15:56.443746 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:56.443729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77899ed4-q89b9" event={"ID":"58c60f7f-9c79-47bc-8cef-8dc444e594ab","Type":"ContainerDied","Data":"7b31f3f95fd217ca9d182081e88a8547ec607641c6c43fda62d20be32b32d922"}
Jul 16 13:15:56.443973 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:15:56.443776    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b31f3f95fd217ca9d182081e88a8547ec607641c6c43fda62d20be32b32d922"
Jul 16 13:16:03.377159 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.377125    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"]
Jul 16 13:16:03.377682 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.377329    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc" podUID="b69d470c-65ba-4139-a609-f483f695d0cd" containerName="maas-api" containerID="cri-o://835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26" gracePeriod=30
Jul 16 13:16:03.411323 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.411295    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"]
Jul 16 13:16:03.411920 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.411892    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:03.414615 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.414593    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-77899ed4-29736795-cqdpv"]
Jul 16 13:16:03.630947 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.630883    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:16:03.734047 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.734015    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls\") pod \"b69d470c-65ba-4139-a609-f483f695d0cd\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") "
Jul 16 13:16:03.734281 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.734063    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjdr4\" (UniqueName: \"kubernetes.io/projected/b69d470c-65ba-4139-a609-f483f695d0cd-kube-api-access-cjdr4\") pod \"b69d470c-65ba-4139-a609-f483f695d0cd\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") "
Jul 16 13:16:03.734281 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.734094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69d470c-65ba-4139-a609-f483f695d0cd-openshift-service-ca\") pod \"b69d470c-65ba-4139-a609-f483f695d0cd\" (UID: \"b69d470c-65ba-4139-a609-f483f695d0cd\") "
Jul 16 13:16:03.734547 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.734517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69d470c-65ba-4139-a609-f483f695d0cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b69d470c-65ba-4139-a609-f483f695d0cd" (UID: "b69d470c-65ba-4139-a609-f483f695d0cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:16:03.736292 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.736263    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b69d470c-65ba-4139-a609-f483f695d0cd" (UID: "b69d470c-65ba-4139-a609-f483f695d0cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:16:03.736390 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.736336    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69d470c-65ba-4139-a609-f483f695d0cd-kube-api-access-cjdr4" (OuterVolumeSpecName: "kube-api-access-cjdr4") pod "b69d470c-65ba-4139-a609-f483f695d0cd" (UID: "b69d470c-65ba-4139-a609-f483f695d0cd"). InnerVolumeSpecName "kube-api-access-cjdr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:16:03.835243 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.835205    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69d470c-65ba-4139-a609-f483f695d0cd-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:03.835243 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.835241    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjdr4\" (UniqueName: \"kubernetes.io/projected/b69d470c-65ba-4139-a609-f483f695d0cd-kube-api-access-cjdr4\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:03.835419 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:03.835254    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69d470c-65ba-4139-a609-f483f695d0cd-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:04.484901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.484859    2564 generic.go:356] "Generic (PLEG): container finished" podID="b69d470c-65ba-4139-a609-f483f695d0cd" containerID="835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26" exitCode=0
Jul 16 13:16:04.484901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.484895    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"
Jul 16 13:16:04.485448 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.484933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc" event={"ID":"b69d470c-65ba-4139-a609-f483f695d0cd","Type":"ContainerDied","Data":"835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26"}
Jul 16 13:16:04.485448 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.484986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc" event={"ID":"b69d470c-65ba-4139-a609-f483f695d0cd","Type":"ContainerDied","Data":"16452166f79eb2082087ec47699e1da904217dfef157c54f09c2ae39885b8fac"}
Jul 16 13:16:04.485448 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.485010    2564 scope.go:117] "RemoveContainer" containerID="835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26"
Jul 16 13:16:04.495428 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.495412    2564 scope.go:117] "RemoveContainer" containerID="835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26"
Jul 16 13:16:04.495684 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:16:04.495664    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26\": container with ID starting with 835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26 not found: ID does not exist" containerID="835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26"
Jul 16 13:16:04.495730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.495694    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26"} err="failed to get container status \"835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26\": rpc error: code = NotFound desc = could not find container \"835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26\": container with ID starting with 835054700abc55d55de94e539cc29bff39a01f9a2d6fb063b8ff4e23fd7ddf26 not found: ID does not exist"
Jul 16 13:16:04.509124 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.509085    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"]
Jul 16 13:16:04.515221 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.515195    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-77899ed4-5b74965d87-sc8mc"]
Jul 16 13:16:04.834499 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.834417    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d5c726-0ef4-4244-9834-7572ee5dc6da" path="/var/lib/kubelet/pods/70d5c726-0ef4-4244-9834-7572ee5dc6da/volumes"
Jul 16 13:16:04.834811 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:04.834799    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69d470c-65ba-4139-a609-f483f695d0cd" path="/var/lib/kubelet/pods/b69d470c-65ba-4139-a609-f483f695d0cd/volumes"
Jul 16 13:16:08.001056 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:08.000997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:14.650738 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:14.650704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:14.761829 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:14.761793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:19.152695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.152656    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"]
Jul 16 13:16:19.153151 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.152862    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy" containerID="cri-o://3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd" gracePeriod=30
Jul 16 13:16:19.165442 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.165407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:19.427752 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.427649    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"]
Jul 16 13:16:19.428285 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428259    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:16:19.428285 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428280    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:16:19.428466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428300    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69d470c-65ba-4139-a609-f483f695d0cd" containerName="maas-api"
Jul 16 13:16:19.428466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428309    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69d470c-65ba-4139-a609-f483f695d0cd" containerName="maas-api"
Jul 16 13:16:19.428466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428344    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58c60f7f-9c79-47bc-8cef-8dc444e594ab" containerName="revoke-keys"
Jul 16 13:16:19.428466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428353    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58c60f7f-9c79-47bc-8cef-8dc444e594ab" containerName="revoke-keys"
Jul 16 13:16:19.428466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428434    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69d470c-65ba-4139-a609-f483f695d0cd" containerName="maas-api"
Jul 16 13:16:19.428466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428445    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1d01b9-d147-4b88-91ab-ffb991822db5" containerName="revoke-keys"
Jul 16 13:16:19.428466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.428459    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="58c60f7f-9c79-47bc-8cef-8dc444e594ab" containerName="revoke-keys"
Jul 16 13:16:19.431938 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.431910    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.435465 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.435444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2177a147-openshift-default-dockercfg-dqqsp\""
Jul 16 13:16:19.472522 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4hb\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-kube-api-access-nf4hb\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472557    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-envoy\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-credential-socket\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-token\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-certs\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istiod-ca-cert\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-data\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-podinfo\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.472901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.472797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-socket\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.487821 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.487789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:19.500571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.500539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"]
Jul 16 13:16:19.573952 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.573921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-socket\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.573952 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.573954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4hb\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-kube-api-access-nf4hb\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574202 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-envoy\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574202 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-credential-socket\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574202 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-token\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574202 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-certs\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574410 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istiod-ca-cert\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574410 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-data\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574410 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-podinfo\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574410 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-socket\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574589 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-credential-socket\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574690 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-data\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574739 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-certs\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.574891 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.574862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istiod-ca-cert\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.576352 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.576328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-envoy\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.576744 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.576726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-podinfo\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.583940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.583914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-token\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.584377 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.584358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4hb\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-kube-api-access-nf4hb\") pod \"e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") " pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.744094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.743994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:19.893369 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.893338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"]
Jul 16 13:16:19.895254 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:16:19.895224    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4defc8f9_a2cc_4410_ae5b_490a65ee7e60.slice/crio-fb2a401ecfd8763b5b20c6b6db33ff82e060eb12e8086af7a853e88048864dc3 WatchSource:0}: Error finding container fb2a401ecfd8763b5b20c6b6db33ff82e060eb12e8086af7a853e88048864dc3: Status 404 returned error can't find the container with id fb2a401ecfd8763b5b20c6b6db33ff82e060eb12e8086af7a853e88048864dc3
Jul 16 13:16:19.897419 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.897386    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:16:19.897516 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.897449    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:16:19.897516 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:19.897477    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:16:20.574626 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.574578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" event={"ID":"4defc8f9-a2cc-4410-ae5b-490a65ee7e60","Type":"ContainerStarted","Data":"477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1"}
Jul 16 13:16:20.575173 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.574637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" event={"ID":"4defc8f9-a2cc-4410-ae5b-490a65ee7e60","Type":"ContainerStarted","Data":"fb2a401ecfd8763b5b20c6b6db33ff82e060eb12e8086af7a853e88048864dc3"}
Jul 16 13:16:20.601771 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.601712    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" podStartSLOduration=1.6016947639999999 podStartE2EDuration="1.601694764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:16:20.601188991 +0000 UTC m=+1864.340178794" watchObservedRunningTime="2026-07-16 13:16:20.601694764 +0000 UTC m=+1864.340684598"
Jul 16 13:16:20.603428 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.603390    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:20.711207 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.711136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:20.712499 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.712471    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"]
Jul 16 13:16:20.716140 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.716103    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.718581 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.718557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2177a147-serving-cert\""
Jul 16 13:16:20.727697 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.727667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"]
Jul 16 13:16:20.744920 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.744888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:20.750325 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.750298    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:20.784523 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.784487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.784713 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.784535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6gv5\" (UniqueName: \"kubernetes.io/projected/5208e5c6-da30-4f22-81f3-9f7a89df89e3-kube-api-access-k6gv5\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.784713 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.784561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5208e5c6-da30-4f22-81f3-9f7a89df89e3-openshift-service-ca\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.804408 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.804362    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:20.885306 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.885268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.885524 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.885322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6gv5\" (UniqueName: \"kubernetes.io/projected/5208e5c6-da30-4f22-81f3-9f7a89df89e3-kube-api-access-k6gv5\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.885524 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.885346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5208e5c6-da30-4f22-81f3-9f7a89df89e3-openshift-service-ca\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.885524 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:16:20.885433    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-serving-cert: secret "maas-api-e2e-derive-2177a147-serving-cert" not found
Jul 16 13:16:20.885524 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:16:20.885513    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls podName:5208e5c6-da30-4f22-81f3-9f7a89df89e3 nodeName:}" failed. No retries permitted until 2026-07-16 13:16:21.385491772 +0000 UTC m=+1865.124481547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls") pod "maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9" (UID: "5208e5c6-da30-4f22-81f3-9f7a89df89e3") : secret "maas-api-e2e-derive-2177a147-serving-cert" not found
Jul 16 13:16:20.886092 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.886073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5208e5c6-da30-4f22-81f3-9f7a89df89e3-openshift-service-ca\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:20.897670 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:20.897636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6gv5\" (UniqueName: \"kubernetes.io/projected/5208e5c6-da30-4f22-81f3-9f7a89df89e3-kube-api-access-k6gv5\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:21.236932 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.236846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:21.389285 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.389245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:21.391730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.391712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls\") pod \"maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:21.580070 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.579977    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:21.581315 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.581290    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:21.612534 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.612497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:21.632419 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.632379    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:21.718000 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.717972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:21.808522 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:21.808498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"]
Jul 16 13:16:21.810923 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:16:21.810896    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5208e5c6_da30_4f22_81f3_9f7a89df89e3.slice/crio-7eaa99c3a24c091b9b16c96a76e8ef5d34c500c7c16e7b53e42af37b792cb711 WatchSource:0}: Error finding container 7eaa99c3a24c091b9b16c96a76e8ef5d34c500c7c16e7b53e42af37b792cb711: Status 404 returned error can't find the container with id 7eaa99c3a24c091b9b16c96a76e8ef5d34c500c7c16e7b53e42af37b792cb711
Jul 16 13:16:22.586502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:22.586465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9" event={"ID":"5208e5c6-da30-4f22-81f3-9f7a89df89e3","Type":"ContainerStarted","Data":"2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce"}
Jul 16 13:16:22.586951 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:22.586525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9" event={"ID":"5208e5c6-da30-4f22-81f3-9f7a89df89e3","Type":"ContainerStarted","Data":"7eaa99c3a24c091b9b16c96a76e8ef5d34c500c7c16e7b53e42af37b792cb711"}
Jul 16 13:16:22.586951 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:22.586601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:22.607429 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:22.607366    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9" podStartSLOduration=2.152784129 podStartE2EDuration="2.607344969s" totalImagesPullingTime="454.56084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:16:22.606441124 +0000 UTC m=+1866.345430941" watchObservedRunningTime="2026-07-16 13:16:22.607344969 +0000 UTC m=+1866.346334749"
Jul 16 13:16:23.662676 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:23.662635    2564 patch_prober.go:28] interesting pod/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 13:16:23.663061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:23.662696    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 13:16:24.423475 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.423407    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:16:24.519536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istiod-ca-cert\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519688 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519566    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-token\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519688 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb9zv\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-kube-api-access-nb9zv\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519688 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519615    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-credential-socket\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519688 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519645    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-podinfo\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519688 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519675    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-data\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519960 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519700    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-socket\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519960 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519771    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-envoy\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519960 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519843    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-certs\") pod \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\" (UID: \"d11d4fb1-cf23-4b41-af89-1ae4f14fb165\") "
Jul 16 13:16:24.519960 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.519930    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:16:24.520217 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.520050    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:16:24.520217 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.520159    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:16:24.520329 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.520282    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.520329 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.520297    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.520329 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.520310    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.520517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.520485    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:16:24.520700 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.520673    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-data" (OuterVolumeSpecName: "istio-data") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:16:24.521953 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.521924    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:16:24.522063 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.522016    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-token" (OuterVolumeSpecName: "istio-token") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:16:24.522167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.522141    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:16:24.522167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.522154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-kube-api-access-nb9zv" (OuterVolumeSpecName: "kube-api-access-nb9zv") pod "d11d4fb1-cf23-4b41-af89-1ae4f14fb165" (UID: "d11d4fb1-cf23-4b41-af89-1ae4f14fb165"). InnerVolumeSpecName "kube-api-access-nb9zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:16:24.600658 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.600623    2564 generic.go:356] "Generic (PLEG): container finished" podID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerID="3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd" exitCode=0
Jul 16 13:16:24.600829 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.600672    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"
Jul 16 13:16:24.600829 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.600699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" event={"ID":"d11d4fb1-cf23-4b41-af89-1ae4f14fb165","Type":"ContainerDied","Data":"3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd"}
Jul 16 13:16:24.600829 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.600759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7" event={"ID":"d11d4fb1-cf23-4b41-af89-1ae4f14fb165","Type":"ContainerDied","Data":"a7d15cc8354cccf70ecbd9556a96cbf7139489f4440ac1360a803fb1d299369a"}
Jul 16 13:16:24.600829 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.600790    2564 scope.go:117] "RemoveContainer" containerID="3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd"
Jul 16 13:16:24.611046 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.611009    2564 scope.go:117] "RemoveContainer" containerID="2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc"
Jul 16 13:16:24.622084 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.622051    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.622084 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.622084    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.622318 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.622099    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb9zv\" (UniqueName: \"kubernetes.io/projected/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-kube-api-access-nb9zv\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.622318 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.622144    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.622318 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.622157    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.622318 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.622169    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d11d4fb1-cf23-4b41-af89-1ae4f14fb165-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:24.626660 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.626631    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"]
Jul 16 13:16:24.630458 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.630434    2564 scope.go:117] "RemoveContainer" containerID="3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd"
Jul 16 13:16:24.630814 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:16:24.630788    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd\": container with ID starting with 3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd not found: ID does not exist" containerID="3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd"
Jul 16 13:16:24.630903 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.630826    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd"} err="failed to get container status \"3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd\": rpc error: code = NotFound desc = could not find container \"3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd\": container with ID starting with 3952b5d4c6425d15400c095ff8ef5ea2abedc914ddcee8ba2b1ebd2eb5fcebdd not found: ID does not exist"
Jul 16 13:16:24.630903 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.630851    2564 scope.go:117] "RemoveContainer" containerID="2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc"
Jul 16 13:16:24.631250 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:16:24.631188    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc\": container with ID starting with 2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc not found: ID does not exist" containerID="2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc"
Jul 16 13:16:24.631250 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.631218    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc"} err="failed to get container status \"2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc\": rpc error: code = NotFound desc = could not find container \"2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc\": container with ID starting with 2223339dd5af183e10364b61a0b7f7e56992e069e78ea2e32ec557c852f0bbdc not found: ID does not exist"
Jul 16 13:16:24.632351 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.632327    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-77899ed4-openshift-default-797db49d7c-7qfq7"]
Jul 16 13:16:24.834284 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:24.834208    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" path="/var/lib/kubelet/pods/d11d4fb1-cf23-4b41-af89-1ae4f14fb165/volumes"
Jul 16 13:16:25.080021 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.079986    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"]
Jul 16 13:16:25.080500 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.080481    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy"
Jul 16 13:16:25.080604 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.080502    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy"
Jul 16 13:16:25.080666 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.080602    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy"
Jul 16 13:16:25.080666 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.080614    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy"
Jul 16 13:16:25.085022 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.084965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"
Jul 16 13:16:25.087462 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.087434    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:16:25.092976 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.092949    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"]
Jul 16 13:16:25.126781 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.126729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7c9eb7-de5a-4fe6-9759-d07b63475582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2177a147-jjm4d\" (UID: \"8b7c9eb7-de5a-4fe6-9759-d07b63475582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"
Jul 16 13:16:25.228236 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.228185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7c9eb7-de5a-4fe6-9759-d07b63475582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2177a147-jjm4d\" (UID: \"8b7c9eb7-de5a-4fe6-9759-d07b63475582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"
Jul 16 13:16:25.228809 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.228786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7c9eb7-de5a-4fe6-9759-d07b63475582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2177a147-jjm4d\" (UID: \"8b7c9eb7-de5a-4fe6-9759-d07b63475582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"
Jul 16 13:16:25.397582 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.397543    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"
Jul 16 13:16:25.536180 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.536155    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"]
Jul 16 13:16:25.537960 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:16:25.537928    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7c9eb7_de5a_4fe6_9759_d07b63475582.slice/crio-aff0cfdf831b45437f72192b949d28d49ec9d3b51da6de4afa86c1758394bfe8 WatchSource:0}: Error finding container aff0cfdf831b45437f72192b949d28d49ec9d3b51da6de4afa86c1758394bfe8: Status 404 returned error can't find the container with id aff0cfdf831b45437f72192b949d28d49ec9d3b51da6de4afa86c1758394bfe8
Jul 16 13:16:25.606726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:25.606686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" event={"ID":"8b7c9eb7-de5a-4fe6-9759-d07b63475582","Type":"ContainerStarted","Data":"aff0cfdf831b45437f72192b949d28d49ec9d3b51da6de4afa86c1758394bfe8"}
Jul 16 13:16:26.615788 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:26.615759    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerID="de6553234e1b19965e9eb3a837bbb89d9caa4a866d45cdf810f6ce647c115c65" exitCode=7
Jul 16 13:16:26.616302 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:26.615841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" event={"ID":"8b7c9eb7-de5a-4fe6-9759-d07b63475582","Type":"ContainerDied","Data":"de6553234e1b19965e9eb3a837bbb89d9caa4a866d45cdf810f6ce647c115c65"}
Jul 16 13:16:26.616302 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:26.616051    2564 scope.go:117] "RemoveContainer" containerID="de6553234e1b19965e9eb3a837bbb89d9caa4a866d45cdf810f6ce647c115c65"
Jul 16 13:16:27.622613 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:27.622554    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerID="0cc5ac69b060ae619245eed4e927b471043a7bb8ebabce16d818f66eb74b9de8" exitCode=7
Jul 16 13:16:27.623085 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:27.622641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" event={"ID":"8b7c9eb7-de5a-4fe6-9759-d07b63475582","Type":"ContainerDied","Data":"0cc5ac69b060ae619245eed4e927b471043a7bb8ebabce16d818f66eb74b9de8"}
Jul 16 13:16:27.623085 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:27.622752    2564 scope.go:117] "RemoveContainer" containerID="de6553234e1b19965e9eb3a837bbb89d9caa4a866d45cdf810f6ce647c115c65"
Jul 16 13:16:27.623085 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:27.622805    2564 scope.go:117] "RemoveContainer" containerID="0cc5ac69b060ae619245eed4e927b471043a7bb8ebabce16d818f66eb74b9de8"
Jul 16 13:16:27.623085 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:16:27.623030    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-2177a147-jjm4d_odh-ai-gateway-infra(8b7c9eb7-de5a-4fe6-9759-d07b63475582)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582"
Jul 16 13:16:28.598533 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:28.598502    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:16:28.633338 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:28.633310    2564 scope.go:117] "RemoveContainer" containerID="0cc5ac69b060ae619245eed4e927b471043a7bb8ebabce16d818f66eb74b9de8"
Jul 16 13:16:28.633723 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:16:28.633517    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-2177a147-jjm4d_odh-ai-gateway-infra(8b7c9eb7-de5a-4fe6-9759-d07b63475582)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582"
Jul 16 13:16:30.862174 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:30.862092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:30.962794 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:30.962752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:34.542784 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:34.542748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:16:36.815514 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:36.815476    2564 patch_prober.go:28] interesting pod/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:45490->10.134.0.51:15021: read: connection reset by peer" start-of-body=
Jul 16 13:16:36.815928 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:36.815540    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:45490->10.134.0.51:15021: read: connection reset by peer"
Jul 16 13:16:37.689267 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:37.689235    2564 generic.go:356] "Generic (PLEG): container finished" podID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerID="477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1" exitCode=0
Jul 16 13:16:37.689451 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:37.689303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" event={"ID":"4defc8f9-a2cc-4410-ae5b-490a65ee7e60","Type":"ContainerDied","Data":"477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1"}
Jul 16 13:16:37.689695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:37.689682    2564 scope.go:117] "RemoveContainer" containerID="477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1"
Jul 16 13:16:37.690643 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:37.690617    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:16:37.690697 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:37.690686    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:16:37.690732 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:37.690715    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:16:38.696516 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:38.696433    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" event={"ID":"4defc8f9-a2cc-4410-ae5b-490a65ee7e60","Type":"ContainerStarted","Data":"9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac"}
Jul 16 13:16:38.744848 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:38.744804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:38.745058 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:38.744867    2564 patch_prober.go:28] interesting pod/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 16 13:16:38.745058 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:38.744936    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 16 13:16:39.745123 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:39.745057    2564 patch_prober.go:28] interesting pod/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 16 13:16:39.745634 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:39.745164    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 16 13:16:40.744920 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:40.744878    2564 patch_prober.go:28] interesting pod/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 16 13:16:40.745163 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:40.744970    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 16 13:16:41.744944 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:41.744905    2564 patch_prober.go:28] interesting pod/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 16 13:16:41.745366 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:41.745333    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 16 13:16:41.828562 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:41.828529    2564 scope.go:117] "RemoveContainer" containerID="0cc5ac69b060ae619245eed4e927b471043a7bb8ebabce16d818f66eb74b9de8"
Jul 16 13:16:42.719807 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:42.719770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" event={"ID":"8b7c9eb7-de5a-4fe6-9759-d07b63475582","Type":"ContainerStarted","Data":"6c40e43a96d0f9cb3afc6dff3df69c0355ce0d27a7cc07c2a044ce4fe696a9a7"}
Jul 16 13:16:42.740973 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:42.740919    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" podStartSLOduration=17.740901652 podStartE2EDuration="17.740901652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:16:42.738418067 +0000 UTC m=+1886.477407846" watchObservedRunningTime="2026-07-16 13:16:42.740901652 +0000 UTC m=+1886.479891461"
Jul 16 13:16:42.748367 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:42.748339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:42.748807 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:42.748783    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:42.749567 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:42.749548    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:16:43.725994 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:43.725958    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerID="6c40e43a96d0f9cb3afc6dff3df69c0355ce0d27a7cc07c2a044ce4fe696a9a7" exitCode=0
Jul 16 13:16:43.726191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:43.726028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" event={"ID":"8b7c9eb7-de5a-4fe6-9759-d07b63475582","Type":"ContainerDied","Data":"6c40e43a96d0f9cb3afc6dff3df69c0355ce0d27a7cc07c2a044ce4fe696a9a7"}
Jul 16 13:16:43.726191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:43.726162    2564 scope.go:117] "RemoveContainer" containerID="0cc5ac69b060ae619245eed4e927b471043a7bb8ebabce16d818f66eb74b9de8"
Jul 16 13:16:43.755537 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:43.755504    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"]
Jul 16 13:16:44.872926 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:44.872898    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"
Jul 16 13:16:45.015912 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.015818    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7c9eb7-de5a-4fe6-9759-d07b63475582-maas-api-service-ca\") pod \"8b7c9eb7-de5a-4fe6-9759-d07b63475582\" (UID: \"8b7c9eb7-de5a-4fe6-9759-d07b63475582\") "
Jul 16 13:16:45.016236 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.016215    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7c9eb7-de5a-4fe6-9759-d07b63475582-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b7c9eb7-de5a-4fe6-9759-d07b63475582" (UID: "8b7c9eb7-de5a-4fe6-9759-d07b63475582"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:16:45.117131 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.117067    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7c9eb7-de5a-4fe6-9759-d07b63475582-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:16:45.739361 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.739334    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"
Jul 16 13:16:45.739569 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.739370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d" event={"ID":"8b7c9eb7-de5a-4fe6-9759-d07b63475582","Type":"ContainerDied","Data":"aff0cfdf831b45437f72192b949d28d49ec9d3b51da6de4afa86c1758394bfe8"}
Jul 16 13:16:45.739569 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.739413    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aff0cfdf831b45437f72192b949d28d49ec9d3b51da6de4afa86c1758394bfe8"
Jul 16 13:16:45.776536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.776502    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"]
Jul 16 13:16:45.781693 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:45.781667    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-jjm4d"]
Jul 16 13:16:46.835021 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:16:46.834988    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" path="/var/lib/kubelet/pods/8b7c9eb7-de5a-4fe6-9759-d07b63475582/volumes"
Jul 16 13:17:25.129015 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.128974    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"]
Jul 16 13:17:25.129658 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129636    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy"
Jul 16 13:17:25.129704 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129662    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11d4fb1-cf23-4b41-af89-1ae4f14fb165" containerName="istio-proxy"
Jul 16 13:17:25.129704 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129675    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.129704 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129684    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.129704 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129697    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.129827 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129707    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.129827 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129718    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.129827 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129727    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.129827 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129817    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.129946 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.129834    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:17:25.132629 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.132609    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"
Jul 16 13:17:25.135076 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.135052    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:17:25.139866 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.139840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"]
Jul 16 13:17:25.173650 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.173610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c47837a-f61a-48d4-a187-e84317deb418-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2177a147-pv7vz\" (UID: \"4c47837a-f61a-48d4-a187-e84317deb418\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"
Jul 16 13:17:25.274836 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.274799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c47837a-f61a-48d4-a187-e84317deb418-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2177a147-pv7vz\" (UID: \"4c47837a-f61a-48d4-a187-e84317deb418\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"
Jul 16 13:17:25.275480 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.275461    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c47837a-f61a-48d4-a187-e84317deb418-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2177a147-pv7vz\" (UID: \"4c47837a-f61a-48d4-a187-e84317deb418\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"
Jul 16 13:17:25.445612 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.445527    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"
Jul 16 13:17:25.582882 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.582855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"]
Jul 16 13:17:25.588149 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:17:25.588079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c47837a_f61a_48d4_a187_e84317deb418.slice/crio-62001d3efa70980746cbeadaf5330cc14be4d27998d65d3300f6f5ae16440076 WatchSource:0}: Error finding container 62001d3efa70980746cbeadaf5330cc14be4d27998d65d3300f6f5ae16440076: Status 404 returned error can't find the container with id 62001d3efa70980746cbeadaf5330cc14be4d27998d65d3300f6f5ae16440076
Jul 16 13:17:25.959594 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.959563    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz" event={"ID":"4c47837a-f61a-48d4-a187-e84317deb418","Type":"ContainerStarted","Data":"f9163a46dd7c2e54c2c9333b0e98bc83a2e36eee320d0a8a1644a50c60247976"}
Jul 16 13:17:25.959761 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.959614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz" event={"ID":"4c47837a-f61a-48d4-a187-e84317deb418","Type":"ContainerStarted","Data":"62001d3efa70980746cbeadaf5330cc14be4d27998d65d3300f6f5ae16440076"}
Jul 16 13:17:25.979568 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:25.979522    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz" podStartSLOduration=0.979507204 podStartE2EDuration="979.507204ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:17:25.978874319 +0000 UTC m=+1929.717864120" watchObservedRunningTime="2026-07-16 13:17:25.979507204 +0000 UTC m=+1929.718496982"
Jul 16 13:17:26.966621 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:26.966581    2564 generic.go:356] "Generic (PLEG): container finished" podID="4c47837a-f61a-48d4-a187-e84317deb418" containerID="f9163a46dd7c2e54c2c9333b0e98bc83a2e36eee320d0a8a1644a50c60247976" exitCode=0
Jul 16 13:17:26.967072 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:26.966622    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz" event={"ID":"4c47837a-f61a-48d4-a187-e84317deb418","Type":"ContainerDied","Data":"f9163a46dd7c2e54c2c9333b0e98bc83a2e36eee320d0a8a1644a50c60247976"}
Jul 16 13:17:28.106169 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:28.106138    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"
Jul 16 13:17:28.199906 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:28.199865    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c47837a-f61a-48d4-a187-e84317deb418-maas-api-service-ca\") pod \"4c47837a-f61a-48d4-a187-e84317deb418\" (UID: \"4c47837a-f61a-48d4-a187-e84317deb418\") "
Jul 16 13:17:28.200280 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:28.200258    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c47837a-f61a-48d4-a187-e84317deb418-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c47837a-f61a-48d4-a187-e84317deb418" (UID: "4c47837a-f61a-48d4-a187-e84317deb418"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:17:28.300997 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:28.300911    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c47837a-f61a-48d4-a187-e84317deb418-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:28.977544 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:28.977509    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz" event={"ID":"4c47837a-f61a-48d4-a187-e84317deb418","Type":"ContainerDied","Data":"62001d3efa70980746cbeadaf5330cc14be4d27998d65d3300f6f5ae16440076"}
Jul 16 13:17:28.977711 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:28.977564    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62001d3efa70980746cbeadaf5330cc14be4d27998d65d3300f6f5ae16440076"
Jul 16 13:17:28.977711 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:28.977520    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2177a147-pv7vz"
Jul 16 13:17:35.664937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.664898    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"]
Jul 16 13:17:35.665383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.665167    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9" podUID="5208e5c6-da30-4f22-81f3-9f7a89df89e3" containerName="maas-api" containerID="cri-o://2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce" gracePeriod=30
Jul 16 13:17:35.689855 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.689820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:35.916645 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.916580    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:17:35.972306 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.972260    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls\") pod \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") "
Jul 16 13:17:35.972488 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.972368    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6gv5\" (UniqueName: \"kubernetes.io/projected/5208e5c6-da30-4f22-81f3-9f7a89df89e3-kube-api-access-k6gv5\") pod \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") "
Jul 16 13:17:35.972488 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.972456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5208e5c6-da30-4f22-81f3-9f7a89df89e3-openshift-service-ca\") pod \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\" (UID: \"5208e5c6-da30-4f22-81f3-9f7a89df89e3\") "
Jul 16 13:17:35.972771 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.972745    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5208e5c6-da30-4f22-81f3-9f7a89df89e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5208e5c6-da30-4f22-81f3-9f7a89df89e3" (UID: "5208e5c6-da30-4f22-81f3-9f7a89df89e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:17:35.974457 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.974433    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5208e5c6-da30-4f22-81f3-9f7a89df89e3" (UID: "5208e5c6-da30-4f22-81f3-9f7a89df89e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:17:35.974457 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:35.974439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5208e5c6-da30-4f22-81f3-9f7a89df89e3-kube-api-access-k6gv5" (OuterVolumeSpecName: "kube-api-access-k6gv5") pod "5208e5c6-da30-4f22-81f3-9f7a89df89e3" (UID: "5208e5c6-da30-4f22-81f3-9f7a89df89e3"). InnerVolumeSpecName "kube-api-access-k6gv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:17:36.015432 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.015401    2564 generic.go:356] "Generic (PLEG): container finished" podID="5208e5c6-da30-4f22-81f3-9f7a89df89e3" containerID="2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce" exitCode=0
Jul 16 13:17:36.015561 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.015444    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"
Jul 16 13:17:36.015561 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.015490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9" event={"ID":"5208e5c6-da30-4f22-81f3-9f7a89df89e3","Type":"ContainerDied","Data":"2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce"}
Jul 16 13:17:36.015561 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.015548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9" event={"ID":"5208e5c6-da30-4f22-81f3-9f7a89df89e3","Type":"ContainerDied","Data":"7eaa99c3a24c091b9b16c96a76e8ef5d34c500c7c16e7b53e42af37b792cb711"}
Jul 16 13:17:36.015742 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.015579    2564 scope.go:117] "RemoveContainer" containerID="2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce"
Jul 16 13:17:36.025012 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.024994    2564 scope.go:117] "RemoveContainer" containerID="2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce"
Jul 16 13:17:36.025349 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:17:36.025326    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce\": container with ID starting with 2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce not found: ID does not exist" containerID="2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce"
Jul 16 13:17:36.025449 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.025357    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce"} err="failed to get container status \"2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce\": rpc error: code = NotFound desc = could not find container \"2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce\": container with ID starting with 2b809c7b102be45ff3455627a2182ab3c42e598efc16acdbc6c18f7b2cad41ce not found: ID does not exist"
Jul 16 13:17:36.040239 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.040215    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"]
Jul 16 13:17:36.050465 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.050440    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2177a147-75d4f86c5c-gqrs9"]
Jul 16 13:17:36.073972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.073949    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5208e5c6-da30-4f22-81f3-9f7a89df89e3-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:36.073972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.073970    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5208e5c6-da30-4f22-81f3-9f7a89df89e3-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:36.074102 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.073980    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6gv5\" (UniqueName: \"kubernetes.io/projected/5208e5c6-da30-4f22-81f3-9f7a89df89e3-kube-api-access-k6gv5\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:36.835293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:36.835259    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5208e5c6-da30-4f22-81f3-9f7a89df89e3" path="/var/lib/kubelet/pods/5208e5c6-da30-4f22-81f3-9f7a89df89e3/volumes"
Jul 16 13:17:40.265218 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:40.265180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:46.686238 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:46.686202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:46.747597 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:46.747558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:50.420407 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:50.420369    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"]
Jul 16 13:17:50.420883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:50.420612    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy" containerID="cri-o://9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac" gracePeriod=30
Jul 16 13:17:50.447597 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:50.447564    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:51.051189 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:51.051150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:51.148893 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:51.148862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:51.251408 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:51.251377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:52.810720 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:52.810686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:55.682791 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.682731    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:17:55.751092 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751046    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istiod-ca-cert\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751256 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751151    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-data\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751256 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751185    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf4hb\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-kube-api-access-nf4hb\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751256 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751209    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-envoy\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751256 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-socket\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751474 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751290    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-podinfo\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751474 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751323    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-token\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751474 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751356    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-certs\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751474 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751431    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-credential-socket\") pod \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\" (UID: \"4defc8f9-a2cc-4410-ae5b-490a65ee7e60\") "
Jul 16 13:17:55.751685 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751503    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:17:55.751749 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.751735    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.752691 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.752462    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-data" (OuterVolumeSpecName: "istio-data") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:17:55.752832 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.752813    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:17:55.753052 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.752955    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:17:55.761168 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.761006    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-kube-api-access-nf4hb" (OuterVolumeSpecName: "kube-api-access-nf4hb") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "kube-api-access-nf4hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:17:55.761168 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.761136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-token" (OuterVolumeSpecName: "istio-token") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:17:55.761499 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.761189    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:17:55.764179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.761779    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:17:55.764179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.763563    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4defc8f9-a2cc-4410-ae5b-490a65ee7e60" (UID: "4defc8f9-a2cc-4410-ae5b-490a65ee7e60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:17:55.852748 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852701    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.852748 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852747    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf4hb\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-kube-api-access-nf4hb\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.852748 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852759    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.852982 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852768    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.852982 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852777    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.852982 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852785    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.852982 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852793    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:55.852982 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:55.852800    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4defc8f9-a2cc-4410-ae5b-490a65ee7e60-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:17:56.127735 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.127691    2564 generic.go:356] "Generic (PLEG): container finished" podID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerID="9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac" exitCode=0
Jul 16 13:17:56.127913 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.127759    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"
Jul 16 13:17:56.127913 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.127766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" event={"ID":"4defc8f9-a2cc-4410-ae5b-490a65ee7e60","Type":"ContainerDied","Data":"9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac"}
Jul 16 13:17:56.127913 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.127835    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5" event={"ID":"4defc8f9-a2cc-4410-ae5b-490a65ee7e60","Type":"ContainerDied","Data":"fb2a401ecfd8763b5b20c6b6db33ff82e060eb12e8086af7a853e88048864dc3"}
Jul 16 13:17:56.127913 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.127860    2564 scope.go:117] "RemoveContainer" containerID="9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac"
Jul 16 13:17:56.137206 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.137190    2564 scope.go:117] "RemoveContainer" containerID="477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1"
Jul 16 13:17:56.145027 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.145009    2564 scope.go:117] "RemoveContainer" containerID="9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac"
Jul 16 13:17:56.145303 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:17:56.145286    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac\": container with ID starting with 9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac not found: ID does not exist" containerID="9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac"
Jul 16 13:17:56.145364 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.145312    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac"} err="failed to get container status \"9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac\": rpc error: code = NotFound desc = could not find container \"9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac\": container with ID starting with 9b4ec97bc19f0ee11456737979ffff24a40a439fabc0e82d767d56110ffa6bac not found: ID does not exist"
Jul 16 13:17:56.145364 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.145328    2564 scope.go:117] "RemoveContainer" containerID="477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1"
Jul 16 13:17:56.145569 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:17:56.145548    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1\": container with ID starting with 477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1 not found: ID does not exist" containerID="477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1"
Jul 16 13:17:56.145664 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.145575    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1"} err="failed to get container status \"477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1\": rpc error: code = NotFound desc = could not find container \"477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1\": container with ID starting with 477ccc2eeccc9acb120399d47c5540f7c95cd7f50674d172e7c7ca81b59876f1 not found: ID does not exist"
Jul 16 13:17:56.152249 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.152225    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"]
Jul 16 13:17:56.157632 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.157610    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2177a147-openshift-default-676bcfcbf5-tmvh5"]
Jul 16 13:17:56.834994 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:56.834961    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" path="/var/lib/kubelet/pods/4defc8f9-a2cc-4410-ae5b-490a65ee7e60/volumes"
Jul 16 13:17:57.004710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:57.004674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:59.380010 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:59.379975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:59.480050 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:59.480013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:59.583195 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:59.583154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:17:59.682204 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:17:59.682081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:00.157037 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:00.157001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:26.189978 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:26.189945    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:32.726590 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:32.726562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:32.835782 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:32.835748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:32.926629 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:32.926589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:48.895819 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:48.895766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:55.239237 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:55.239205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:55.312122 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:55.312085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:55.400359 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:55.400320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:18:55.499780 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:18:55.499695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:06.057736 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:06.057704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:06.900585 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:06.900545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:13.332631 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:13.332593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:13.396492 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:13.396458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:13.560611 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:13.560579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:13.663123 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:13.663088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:14.413815 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:14.413785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:14.516032 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:14.515997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:14.615098 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:14.615047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:16.301729 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:16.301691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:16.916096 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:16.916065    2564 scope.go:117] "RemoveContainer" containerID="3f65e8e784156f72347119ffc3eda6050af143ef4443e1499635d9f44a4c5058"
Jul 16 13:19:22.533172 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:22.533138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:22.635249 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:22.635218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:22.704950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:22.704917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:23.236803 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:23.236771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:29.578236 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:29.578201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:29.680726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:29.680697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:29.823752 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:29.823713    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:30.147789 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.147751    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"]
Jul 16 13:19:30.148188 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148171    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5208e5c6-da30-4f22-81f3-9f7a89df89e3" containerName="maas-api"
Jul 16 13:19:30.148246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148189    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5208e5c6-da30-4f22-81f3-9f7a89df89e3" containerName="maas-api"
Jul 16 13:19:30.148246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148206    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c47837a-f61a-48d4-a187-e84317deb418" containerName="revoke-keys"
Jul 16 13:19:30.148246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148212    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c47837a-f61a-48d4-a187-e84317deb418" containerName="revoke-keys"
Jul 16 13:19:30.148246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148227    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy"
Jul 16 13:19:30.148246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148233    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy"
Jul 16 13:19:30.148246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148240    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy"
Jul 16 13:19:30.148246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148245    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy"
Jul 16 13:19:30.148466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148309    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5208e5c6-da30-4f22-81f3-9f7a89df89e3" containerName="maas-api"
Jul 16 13:19:30.148466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148320    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c47837a-f61a-48d4-a187-e84317deb418" containerName="revoke-keys"
Jul 16 13:19:30.148466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148326    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy"
Jul 16 13:19:30.148466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148334    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7c9eb7-de5a-4fe6-9759-d07b63475582" containerName="revoke-keys"
Jul 16 13:19:30.148466 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.148344    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4defc8f9-a2cc-4410-ae5b-490a65ee7e60" containerName="istio-proxy"
Jul 16 13:19:30.150335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.150317    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.153029 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.153007    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1af4e64f-openshift-default-dockercfg-6blk8\""
Jul 16 13:19:30.177271 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.177232    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"]
Jul 16 13:19:30.185489 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.185460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:30.255479 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-certs\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255479 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-podinfo\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-envoy\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7vzl\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-kube-api-access-q7vzl\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-socket\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-data\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istiod-ca-cert\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255889 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-credential-socket\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.255889 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.255744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-token\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357277 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-certs\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-podinfo\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-envoy\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7vzl\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-kube-api-access-q7vzl\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-socket\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-data\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istiod-ca-cert\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357823 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-credential-socket\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357823 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-token\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357942 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-data\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.357942 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.357865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-socket\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.358144 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.358094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-credential-socket\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.358277 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.358160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-certs\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.358506 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.358489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istiod-ca-cert\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.359865 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.359847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-envoy\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.359943 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.359924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-podinfo\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.373095 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.373067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-token\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.373399 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.373379    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7vzl\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-kube-api-access-q7vzl\") pod \"e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") " pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.462956 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.462858    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:30.514303 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.514233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:30.620742 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.620717    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"]
Jul 16 13:19:30.622064 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:19:30.622038    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e03bb9_0f6d_4611_a851_f843dcf7e26c.slice/crio-835389c8282846b327476be337306010490e5cf58e8d63bbaebc1771cf80c1f0 WatchSource:0}: Error finding container 835389c8282846b327476be337306010490e5cf58e8d63bbaebc1771cf80c1f0: Status 404 returned error can't find the container with id 835389c8282846b327476be337306010490e5cf58e8d63bbaebc1771cf80c1f0
Jul 16 13:19:30.624126 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.624066    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:19:30.624244 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.624168    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:19:30.624244 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:30.624216    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:19:31.617185 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:31.617147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" event={"ID":"a6e03bb9-0f6d-4611-a851-f843dcf7e26c","Type":"ContainerStarted","Data":"c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703"}
Jul 16 13:19:31.617350 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:31.617200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" event={"ID":"a6e03bb9-0f6d-4611-a851-f843dcf7e26c","Type":"ContainerStarted","Data":"835389c8282846b327476be337306010490e5cf58e8d63bbaebc1771cf80c1f0"}
Jul 16 13:19:31.645700 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:31.645638    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" podStartSLOduration=1.645619354 podStartE2EDuration="1.645619354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:19:31.64462239 +0000 UTC m=+2055.383612171" watchObservedRunningTime="2026-07-16 13:19:31.645619354 +0000 UTC m=+2055.384609132"
Jul 16 13:19:32.463972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:32.463936    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:32.468856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:32.468828    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:32.621828 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:32.621798    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:32.622703 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:32.622684    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:33.723748 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.723701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:33.818949 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.818915    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"]
Jul 16 13:19:33.821809 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.821785    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:33.824125 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.824086    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1af4e64f-serving-cert\""
Jul 16 13:19:33.835200 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.835173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"]
Jul 16 13:19:33.848614 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.848580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:33.889331 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.889297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:33.889493 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.889360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr68l\" (UniqueName: \"kubernetes.io/projected/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-kube-api-access-cr68l\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:33.889493 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.889467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-openshift-service-ca\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:33.973328 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.973283    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:33.990556 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.990475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr68l\" (UniqueName: \"kubernetes.io/projected/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-kube-api-access-cr68l\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:33.990556 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.990528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-openshift-service-ca\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:33.990760 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.990587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:33.990760 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:19:33.990705    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-serving-cert: secret "maas-api-e2e-mt-1af4e64f-serving-cert" not found
Jul 16 13:19:33.990870 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:19:33.990781    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls podName:79e689de-0855-4e0b-9cbf-3b5ede7af1b9 nodeName:}" failed. No retries permitted until 2026-07-16 13:19:34.490759313 +0000 UTC m=+2058.229749070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls") pod "maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm" (UID: "79e689de-0855-4e0b-9cbf-3b5ede7af1b9") : secret "maas-api-e2e-mt-1af4e64f-serving-cert" not found
Jul 16 13:19:33.991249 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:33.991230    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-openshift-service-ca\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:34.008245 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.008214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr68l\" (UniqueName: \"kubernetes.io/projected/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-kube-api-access-cr68l\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:34.381987 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.381934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:34.479699 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.479647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:34.495041 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.495014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:34.497464 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.497435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls\") pod \"maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:34.733869 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.733776    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:34.876518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.876493    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"]
Jul 16 13:19:34.878408 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:19:34.878370    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e689de_0855_4e0b_9cbf_3b5ede7af1b9.slice/crio-feb1806d393aabf3612e5e3a8987782228ea9a06152ac1d57ed808d2b3d93647 WatchSource:0}: Error finding container feb1806d393aabf3612e5e3a8987782228ea9a06152ac1d57ed808d2b3d93647: Status 404 returned error can't find the container with id feb1806d393aabf3612e5e3a8987782228ea9a06152ac1d57ed808d2b3d93647
Jul 16 13:19:34.879938 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:34.879919    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 13:19:35.640142 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:35.640095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm" event={"ID":"79e689de-0855-4e0b-9cbf-3b5ede7af1b9","Type":"ContainerStarted","Data":"e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05"}
Jul 16 13:19:35.640253 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:35.640163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm" event={"ID":"79e689de-0855-4e0b-9cbf-3b5ede7af1b9","Type":"ContainerStarted","Data":"feb1806d393aabf3612e5e3a8987782228ea9a06152ac1d57ed808d2b3d93647"}
Jul 16 13:19:36.376849 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:36.376814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:36.477202 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:36.477166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:36.645946 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:36.645861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:36.666897 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:36.666835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm" podStartSLOduration=2.966257701 podStartE2EDuration="3.666817831s" totalImagesPullingTime="700.56013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:19:36.664798283 +0000 UTC m=+2060.403788074" watchObservedRunningTime="2026-07-16 13:19:36.666817831 +0000 UTC m=+2060.405807613"
Jul 16 13:19:37.382921 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:37.382886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:37.489373 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:37.489336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:38.129158 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:38.129105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:38.831577 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:38.831545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:38.932171 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:38.932132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:39.317170 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:39.317138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:42.657813 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:42.657782    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:45.804245 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:45.804205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:45.904213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:45.904172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:46.217006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.216972    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"]
Jul 16 13:19:46.220890 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.220861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"
Jul 16 13:19:46.223532 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.223499    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:19:46.239100 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.239060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"]
Jul 16 13:19:46.306222 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.306183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769b5008-b397-4c55-9e17-ec6b3cdf841e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm\" (UID: \"769b5008-b397-4c55-9e17-ec6b3cdf841e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"
Jul 16 13:19:46.406982 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.406949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769b5008-b397-4c55-9e17-ec6b3cdf841e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm\" (UID: \"769b5008-b397-4c55-9e17-ec6b3cdf841e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"
Jul 16 13:19:46.407610 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.407590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769b5008-b397-4c55-9e17-ec6b3cdf841e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm\" (UID: \"769b5008-b397-4c55-9e17-ec6b3cdf841e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"
Jul 16 13:19:46.535873 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.535831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"
Jul 16 13:19:46.691378 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:46.691348    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"]
Jul 16 13:19:46.693345 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:19:46.693316    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769b5008_b397_4c55_9e17_ec6b3cdf841e.slice/crio-e61b01b44f41d3db3bd862009912a735032a9bcd07e12c69029aceacb319e33b WatchSource:0}: Error finding container e61b01b44f41d3db3bd862009912a735032a9bcd07e12c69029aceacb319e33b: Status 404 returned error can't find the container with id e61b01b44f41d3db3bd862009912a735032a9bcd07e12c69029aceacb319e33b
Jul 16 13:19:47.706489 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:47.706449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm" event={"ID":"769b5008-b397-4c55-9e17-ec6b3cdf841e","Type":"ContainerStarted","Data":"2e429196d981a682c537b01a1a23b35989e28f8b87fb7373b8a8d10bf4b2e996"}
Jul 16 13:19:47.706996 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:47.706505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm" event={"ID":"769b5008-b397-4c55-9e17-ec6b3cdf841e","Type":"ContainerStarted","Data":"e61b01b44f41d3db3bd862009912a735032a9bcd07e12c69029aceacb319e33b"}
Jul 16 13:19:47.729462 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:47.729397    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm" podStartSLOduration=1.729376523 podStartE2EDuration="1.729376523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:19:47.727632847 +0000 UTC m=+2071.466622628" watchObservedRunningTime="2026-07-16 13:19:47.729376523 +0000 UTC m=+2071.468366303"
Jul 16 13:19:48.665350 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:48.665307    2564 patch_prober.go:28] interesting pod/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 13:19:48.665573 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:48.665405    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 13:19:48.721472 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:48.721436    2564 generic.go:356] "Generic (PLEG): container finished" podID="769b5008-b397-4c55-9e17-ec6b3cdf841e" containerID="2e429196d981a682c537b01a1a23b35989e28f8b87fb7373b8a8d10bf4b2e996" exitCode=0
Jul 16 13:19:48.721959 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:48.721519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm" event={"ID":"769b5008-b397-4c55-9e17-ec6b3cdf841e","Type":"ContainerDied","Data":"2e429196d981a682c537b01a1a23b35989e28f8b87fb7373b8a8d10bf4b2e996"}
Jul 16 13:19:49.732644 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.732565    2564 generic.go:356] "Generic (PLEG): container finished" podID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerID="c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703" exitCode=0
Jul 16 13:19:49.732644 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.732638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" event={"ID":"a6e03bb9-0f6d-4611-a851-f843dcf7e26c","Type":"ContainerDied","Data":"c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703"}
Jul 16 13:19:49.733411 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.733216    2564 scope.go:117] "RemoveContainer" containerID="c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703"
Jul 16 13:19:49.734253 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.734222    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:19:49.734383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.734340    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:19:49.734447 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.734393    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:19:49.889553 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.889527    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"
Jul 16 13:19:49.933366 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.933328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769b5008-b397-4c55-9e17-ec6b3cdf841e-maas-api-service-ca\") pod \"769b5008-b397-4c55-9e17-ec6b3cdf841e\" (UID: \"769b5008-b397-4c55-9e17-ec6b3cdf841e\") "
Jul 16 13:19:49.933748 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:49.933717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/769b5008-b397-4c55-9e17-ec6b3cdf841e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "769b5008-b397-4c55-9e17-ec6b3cdf841e" (UID: "769b5008-b397-4c55-9e17-ec6b3cdf841e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:19:50.034014 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:50.033930    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769b5008-b397-4c55-9e17-ec6b3cdf841e-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:19:50.742595 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:50.742553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm" event={"ID":"769b5008-b397-4c55-9e17-ec6b3cdf841e","Type":"ContainerDied","Data":"e61b01b44f41d3db3bd862009912a735032a9bcd07e12c69029aceacb319e33b"}
Jul 16 13:19:50.743094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:50.742621    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e61b01b44f41d3db3bd862009912a735032a9bcd07e12c69029aceacb319e33b"
Jul 16 13:19:50.743094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:50.742694    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm"
Jul 16 13:19:50.755433 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:50.755406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" event={"ID":"a6e03bb9-0f6d-4611-a851-f843dcf7e26c","Type":"ContainerStarted","Data":"eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49"}
Jul 16 13:19:51.463787 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:51.463752    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:51.464134 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:51.464086    2564 patch_prober.go:28] interesting pod/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 16 13:19:51.464198 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:51.464164    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 16 13:19:52.463749 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:52.463709    2564 patch_prober.go:28] interesting pod/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 16 13:19:52.464185 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:52.463780    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 16 13:19:53.464232 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:53.464191    2564 patch_prober.go:28] interesting pod/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 16 13:19:53.464664 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:53.464248    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 16 13:19:54.463669 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:54.463629    2564 patch_prober.go:28] interesting pod/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 16 13:19:54.463851 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:54.463686    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 16 13:19:55.466538 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:55.466507    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:55.466898 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:55.466765    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:55.467562 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:55.467542    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:19:56.755983 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:56.755943    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"]
Jul 16 13:19:56.756425 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:56.756204    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm" podUID="79e689de-0855-4e0b-9cbf-3b5ede7af1b9" containerName="maas-api" containerID="cri-o://e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05" gracePeriod=30
Jul 16 13:19:56.892970 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:56.892921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:19:57.015939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.015875    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:57.101897 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.101856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr68l\" (UniqueName: \"kubernetes.io/projected/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-kube-api-access-cr68l\") pod \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") "
Jul 16 13:19:57.102069 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.101945    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls\") pod \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") "
Jul 16 13:19:57.102069 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.101991    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-openshift-service-ca\") pod \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\" (UID: \"79e689de-0855-4e0b-9cbf-3b5ede7af1b9\") "
Jul 16 13:19:57.102438 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.102413    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79e689de-0855-4e0b-9cbf-3b5ede7af1b9" (UID: "79e689de-0855-4e0b-9cbf-3b5ede7af1b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:19:57.104076 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.104057    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-kube-api-access-cr68l" (OuterVolumeSpecName: "kube-api-access-cr68l") pod "79e689de-0855-4e0b-9cbf-3b5ede7af1b9" (UID: "79e689de-0855-4e0b-9cbf-3b5ede7af1b9"). InnerVolumeSpecName "kube-api-access-cr68l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:19:57.104190 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.104165    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79e689de-0855-4e0b-9cbf-3b5ede7af1b9" (UID: "79e689de-0855-4e0b-9cbf-3b5ede7af1b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:19:57.203536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.203499    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:19:57.203536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.203532    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:19:57.203536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.203542    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr68l\" (UniqueName: \"kubernetes.io/projected/79e689de-0855-4e0b-9cbf-3b5ede7af1b9-kube-api-access-cr68l\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:19:57.791611 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.791570    2564 generic.go:356] "Generic (PLEG): container finished" podID="79e689de-0855-4e0b-9cbf-3b5ede7af1b9" containerID="e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05" exitCode=0
Jul 16 13:19:57.791611 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.791610    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"
Jul 16 13:19:57.792198 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.791654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm" event={"ID":"79e689de-0855-4e0b-9cbf-3b5ede7af1b9","Type":"ContainerDied","Data":"e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05"}
Jul 16 13:19:57.792198 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.791702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm" event={"ID":"79e689de-0855-4e0b-9cbf-3b5ede7af1b9","Type":"ContainerDied","Data":"feb1806d393aabf3612e5e3a8987782228ea9a06152ac1d57ed808d2b3d93647"}
Jul 16 13:19:57.792198 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.791723    2564 scope.go:117] "RemoveContainer" containerID="e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05"
Jul 16 13:19:57.800566 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.800549    2564 scope.go:117] "RemoveContainer" containerID="e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05"
Jul 16 13:19:57.800815 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:19:57.800797    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05\": container with ID starting with e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05 not found: ID does not exist" containerID="e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05"
Jul 16 13:19:57.800877 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.800825    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05"} err="failed to get container status \"e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05\": rpc error: code = NotFound desc = could not find container \"e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05\": container with ID starting with e96c7c9c0422cc8f484897063d7adacd353ed5fbe91c23b869bb9e135197fd05 not found: ID does not exist"
Jul 16 13:19:57.815769 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.815743    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"]
Jul 16 13:19:57.820420 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:57.820398    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1af4e64f-79656ddc58-x27vm"]
Jul 16 13:19:58.835302 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:19:58.835271    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79e689de-0855-4e0b-9cbf-3b5ede7af1b9" path="/var/lib/kubelet/pods/79e689de-0855-4e0b-9cbf-3b5ede7af1b9/volumes"
Jul 16 13:20:01.308941 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:01.308907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:07.752576 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:07.752537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:07.810286 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:07.810256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:12.004217 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:12.004181    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"]
Jul 16 13:20:12.004707 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:12.004455    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy" containerID="cri-o://eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49" gracePeriod=30
Jul 16 13:20:12.023480 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:12.023447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:12.271701 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:12.271606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:12.400523 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:12.400488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:12.498567 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:12.498528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:12.632363 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:12.632324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:16.937469 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:16.937439    2564 scope.go:117] "RemoveContainer" containerID="41c458fc0b48a90604849f049e35ecf5b89a83eb83d5ff140837b7bbc406a5a3"
Jul 16 13:20:17.255882 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.255858    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:20:17.385320 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385287    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istiod-ca-cert\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385339    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-certs\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-token\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385403    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-data\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385453    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-socket\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385501    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7vzl\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-kube-api-access-q7vzl\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385795 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385525    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-envoy\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385795 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385554    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-credential-socket\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385795 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385617    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-podinfo\") pod \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\" (UID: \"a6e03bb9-0f6d-4611-a851-f843dcf7e26c\") "
Jul 16 13:20:17.385795 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385700    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:20:17.385795 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385750    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:20:17.386045 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:20:17.386045 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.385989    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.386045 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.386007    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.386225 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.386050    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:20:17.386225 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.386080    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.386335 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.386314    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:20:17.387823 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.387792    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:20:17.387937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.387829    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:20:17.388081 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.388060    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-kube-api-access-q7vzl" (OuterVolumeSpecName: "kube-api-access-q7vzl") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "kube-api-access-q7vzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:20:17.388081 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.388069    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6e03bb9-0f6d-4611-a851-f843dcf7e26c" (UID: "a6e03bb9-0f6d-4611-a851-f843dcf7e26c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:20:17.486649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.486546    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.486649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.486584    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.486649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.486595    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7vzl\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-kube-api-access-q7vzl\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.486649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.486605    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.486649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.486613    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.486649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.486621    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e03bb9-0f6d-4611-a851-f843dcf7e26c-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:20:17.900782 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.900749    2564 generic.go:356] "Generic (PLEG): container finished" podID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerID="eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49" exitCode=0
Jul 16 13:20:17.900948 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.900809    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"
Jul 16 13:20:17.900948 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.900830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" event={"ID":"a6e03bb9-0f6d-4611-a851-f843dcf7e26c","Type":"ContainerDied","Data":"eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49"}
Jul 16 13:20:17.900948 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.900892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59" event={"ID":"a6e03bb9-0f6d-4611-a851-f843dcf7e26c","Type":"ContainerDied","Data":"835389c8282846b327476be337306010490e5cf58e8d63bbaebc1771cf80c1f0"}
Jul 16 13:20:17.900948 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.900928    2564 scope.go:117] "RemoveContainer" containerID="eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49"
Jul 16 13:20:17.910292 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.910276    2564 scope.go:117] "RemoveContainer" containerID="c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703"
Jul 16 13:20:17.918333 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.918312    2564 scope.go:117] "RemoveContainer" containerID="eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49"
Jul 16 13:20:17.918583 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:20:17.918565    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49\": container with ID starting with eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49 not found: ID does not exist" containerID="eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49"
Jul 16 13:20:17.918651 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.918589    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49"} err="failed to get container status \"eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49\": rpc error: code = NotFound desc = could not find container \"eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49\": container with ID starting with eac4250ebb98aa2b219dfc6743c959d8cff06a7cbd3a898617f293c680d6ec49 not found: ID does not exist"
Jul 16 13:20:17.918651 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.918606    2564 scope.go:117] "RemoveContainer" containerID="c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703"
Jul 16 13:20:17.918814 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:20:17.918797    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703\": container with ID starting with c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703 not found: ID does not exist" containerID="c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703"
Jul 16 13:20:17.918853 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.918821    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703"} err="failed to get container status \"c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703\": rpc error: code = NotFound desc = could not find container \"c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703\": container with ID starting with c8d0cac67fb00dbc510ac8762d140b44ea0d62ee20f74ce8a50127fbc62a2703 not found: ID does not exist"
Jul 16 13:20:17.924273 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.924250    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"]
Jul 16 13:20:17.928661 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:17.928639    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1af4e64f-openshift-default-c5cb8557f-56g59"]
Jul 16 13:20:18.833832 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:18.833799    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" path="/var/lib/kubelet/pods/a6e03bb9-0f6d-4611-a851-f843dcf7e26c/volumes"
Jul 16 13:20:19.098275 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:19.098243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:19.180984 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:19.180956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:19.268262 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:19.268226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:19.364105 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:19.364023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:19.486719 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:19.486686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:25.730672 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:25.730641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:25.793420 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:25.793386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:32.721893 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:32.721861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:33.032034 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.031948    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"]
Jul 16 13:20:33.032366 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032351    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="769b5008-b397-4c55-9e17-ec6b3cdf841e" containerName="revoke-keys"
Jul 16 13:20:33.032421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032368    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="769b5008-b397-4c55-9e17-ec6b3cdf841e" containerName="revoke-keys"
Jul 16 13:20:33.032421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032383    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy"
Jul 16 13:20:33.032421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032388    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy"
Jul 16 13:20:33.032421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032398    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy"
Jul 16 13:20:33.032421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032403    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy"
Jul 16 13:20:33.032421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032412    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79e689de-0855-4e0b-9cbf-3b5ede7af1b9" containerName="maas-api"
Jul 16 13:20:33.032421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032418    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="79e689de-0855-4e0b-9cbf-3b5ede7af1b9" containerName="maas-api"
Jul 16 13:20:33.032634 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032468    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy"
Jul 16 13:20:33.032634 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032476    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="79e689de-0855-4e0b-9cbf-3b5ede7af1b9" containerName="maas-api"
Jul 16 13:20:33.032634 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.032486    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="769b5008-b397-4c55-9e17-ec6b3cdf841e" containerName="revoke-keys"
Jul 16 13:20:33.035655 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.035640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.038139 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.038098    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a1f86fcf-openshift-default-dockercfg-hxdl2\""
Jul 16 13:20:33.047381 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.047360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"]
Jul 16 13:20:33.049371 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.049345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:33.225575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc7d44a-4ea2-4327-81b1-776984c5660b-istiod-ca-cert\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-podinfo\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225812 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-socket\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225812 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-token\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225812 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-credential-socket\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225812 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjkdh\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-kube-api-access-bjkdh\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225812 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-certs\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225812 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-data\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.225812 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.225789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-envoy\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.326896 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.326798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-credential-socket\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.326896 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.326836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjkdh\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-kube-api-access-bjkdh\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327152 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.326961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-certs\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327152 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.326995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-data\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327152 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-envoy\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327152 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc7d44a-4ea2-4327-81b1-776984c5660b-istiod-ca-cert\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327152 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-podinfo\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327422 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-socket\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327422 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-token\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327422 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-credential-socket\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327778 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-socket\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.327964 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.327942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-certs\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.328146 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.328125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-data\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.328809 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.328784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc7d44a-4ea2-4327-81b1-776984c5660b-istiod-ca-cert\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.330000 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.329969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-envoy\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.330305 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.330287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-podinfo\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.335746 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.335725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-token\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.335859 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.335745    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjkdh\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-kube-api-access-bjkdh\") pod \"e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") " pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.347797 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.347775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:33.498550 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.498526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"]
Jul 16 13:20:33.501485 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:20:33.501457    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc7d44a_4ea2_4327_81b1_776984c5660b.slice/crio-d1bd3fe96371ab10cf7cc6081471d19d2e9a77d26bdef6d0285ab859923c286e WatchSource:0}: Error finding container d1bd3fe96371ab10cf7cc6081471d19d2e9a77d26bdef6d0285ab859923c286e: Status 404 returned error can't find the container with id d1bd3fe96371ab10cf7cc6081471d19d2e9a77d26bdef6d0285ab859923c286e
Jul 16 13:20:33.503704 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.503667    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:20:33.503786 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.503738    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:20:33.503786 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.503772    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:20:33.727165 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.727125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:33.983376 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.983294    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" event={"ID":"bdc7d44a-4ea2-4327-81b1-776984c5660b","Type":"ContainerStarted","Data":"010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce"}
Jul 16 13:20:33.983376 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:33.983345    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" event={"ID":"bdc7d44a-4ea2-4327-81b1-776984c5660b","Type":"ContainerStarted","Data":"d1bd3fe96371ab10cf7cc6081471d19d2e9a77d26bdef6d0285ab859923c286e"}
Jul 16 13:20:34.006511 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:34.006453    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podStartSLOduration=1.006434808 podStartE2EDuration="1.006434808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:20:34.003940659 +0000 UTC m=+2117.742930437" watchObservedRunningTime="2026-07-16 13:20:34.006434808 +0000 UTC m=+2117.745424587"
Jul 16 13:20:34.348349 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:34.348318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:34.353405 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:34.353376    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:34.989343 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:34.989312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:34.990391 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:34.990370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:35.948429 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:35.948380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:36.035018 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.034600    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"]
Jul 16 13:20:36.035522 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.035306    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e03bb9-0f6d-4611-a851-f843dcf7e26c" containerName="istio-proxy"
Jul 16 13:20:36.036344 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.036319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:36.038548 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.038529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.041086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.041061    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a1f86fcf-serving-cert\""
Jul 16 13:20:36.052134 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.051839    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"]
Jul 16 13:20:36.054721 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.054697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8065d731-f6be-47c3-be08-1d4bae49fac4-openshift-service-ca\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.054831 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.054726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmkbr\" (UniqueName: \"kubernetes.io/projected/8065d731-f6be-47c3-be08-1d4bae49fac4-kube-api-access-nmkbr\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.054945 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.054898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.116616 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.116572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:36.155976 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.155932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8065d731-f6be-47c3-be08-1d4bae49fac4-openshift-service-ca\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.155976 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.155981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmkbr\" (UniqueName: \"kubernetes.io/projected/8065d731-f6be-47c3-be08-1d4bae49fac4-kube-api-access-nmkbr\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.156222 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.156030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.156222 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:20:36.156187    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-serving-cert: secret "maas-api-e2e-mt-a1f86fcf-serving-cert" not found
Jul 16 13:20:36.156305 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:20:36.156255    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls podName:8065d731-f6be-47c3-be08-1d4bae49fac4 nodeName:}" failed. No retries permitted until 2026-07-16 13:20:36.65623494 +0000 UTC m=+2120.395224703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls") pod "maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5" (UID: "8065d731-f6be-47c3-be08-1d4bae49fac4") : secret "maas-api-e2e-mt-a1f86fcf-serving-cert" not found
Jul 16 13:20:36.156593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.156573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8065d731-f6be-47c3-be08-1d4bae49fac4-openshift-service-ca\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.168501 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.168476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmkbr\" (UniqueName: \"kubernetes.io/projected/8065d731-f6be-47c3-be08-1d4bae49fac4-kube-api-access-nmkbr\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.659934 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.659893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.662380 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.662356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls\") pod \"maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:36.669447 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.669418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:36.765994 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.765955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:36.953623 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:36.953525    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:37.095084 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:37.095058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"]
Jul 16 13:20:37.096561 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:20:37.096525    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8065d731_f6be_47c3_be08_1d4bae49fac4.slice/crio-180849b98de466448dee2482bd628b6d5ad67af38f2df1276e9320521cc1631f WatchSource:0}: Error finding container 180849b98de466448dee2482bd628b6d5ad67af38f2df1276e9320521cc1631f: Status 404 returned error can't find the container with id 180849b98de466448dee2482bd628b6d5ad67af38f2df1276e9320521cc1631f
Jul 16 13:20:38.006228 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:38.006181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5" event={"ID":"8065d731-f6be-47c3-be08-1d4bae49fac4","Type":"ContainerStarted","Data":"e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668"}
Jul 16 13:20:38.006417 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:38.006259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5" event={"ID":"8065d731-f6be-47c3-be08-1d4bae49fac4","Type":"ContainerStarted","Data":"180849b98de466448dee2482bd628b6d5ad67af38f2df1276e9320521cc1631f"}
Jul 16 13:20:38.006417 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:38.006313    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:38.028515 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:38.028466    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5" podStartSLOduration=1.6391809899999998 podStartE2EDuration="2.028447042s" totalImagesPullingTime="389.266052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:20:38.025813949 +0000 UTC m=+2121.764803727" watchObservedRunningTime="2026-07-16 13:20:38.028447042 +0000 UTC m=+2121.767436822"
Jul 16 13:20:40.456778 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:40.456670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:44.016973 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:44.016942    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:20:46.707930 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:46.707897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:20:49.079868 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:49.079779    2564 generic.go:356] "Generic (PLEG): container finished" podID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerID="010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce" exitCode=0
Jul 16 13:20:49.079868 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:49.079851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" event={"ID":"bdc7d44a-4ea2-4327-81b1-776984c5660b","Type":"ContainerDied","Data":"010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce"}
Jul 16 13:20:49.080339 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:49.080260    2564 scope.go:117] "RemoveContainer" containerID="010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce"
Jul 16 13:20:49.081274 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:49.081246    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:20:49.081338 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:49.081315    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:20:49.081377 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:49.081366    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:20:49.989371 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:49.989326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:50.088061 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:50.088014    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" event={"ID":"bdc7d44a-4ea2-4327-81b1-776984c5660b","Type":"ContainerStarted","Data":"6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a"}
Jul 16 13:20:50.348340 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:50.348246    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:50.349763 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:50.349719    2564 patch_prober.go:28] interesting pod/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 16 13:20:50.349946 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:50.349790    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 16 13:20:51.349097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:51.349062    2564 patch_prober.go:28] interesting pod/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 16 13:20:51.349729 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:51.349699    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 16 13:20:52.348396 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:52.348347    2564 patch_prober.go:28] interesting pod/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 16 13:20:52.348621 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:52.348419    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 16 13:20:53.349064 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:53.349017    2564 patch_prober.go:28] interesting pod/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 16 13:20:53.349572 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:53.349122    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 16 13:20:54.348423 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:54.348383    2564 patch_prober.go:28] interesting pod/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 16 13:20:54.348716 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:54.348687    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 16 13:20:55.353046 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:55.353015    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:55.353519 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:55.353308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:20:55.354136 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:20:55.354100    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:21:16.960857 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:16.960780    2564 scope.go:117] "RemoveContainer" containerID="0b31b4d655127bbe2afc1383d565cfbae5a4c14e7938494b808095effb0bd838"
Jul 16 13:21:16.968940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:16.968919    2564 scope.go:117] "RemoveContainer" containerID="0fb5dc254d828fcdb6a9eea7db0b8bbb61ebce0410850c1d73adede2d83b396d"
Jul 16 13:21:23.973001 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:23.972963    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"]
Jul 16 13:21:23.976374 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:23.976357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"
Jul 16 13:21:23.979006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:23.978986    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:21:23.986783 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:23.986760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"]
Jul 16 13:21:24.074321 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:24.074284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03d02fb8-d87f-4902-8759-43f5774d13c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2\" (UID: \"03d02fb8-d87f-4902-8759-43f5774d13c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"
Jul 16 13:21:24.174828 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:24.174791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03d02fb8-d87f-4902-8759-43f5774d13c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2\" (UID: \"03d02fb8-d87f-4902-8759-43f5774d13c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"
Jul 16 13:21:24.175448 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:24.175427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03d02fb8-d87f-4902-8759-43f5774d13c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2\" (UID: \"03d02fb8-d87f-4902-8759-43f5774d13c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"
Jul 16 13:21:24.287090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:24.287010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"
Jul 16 13:21:24.428926 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:24.428897    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"]
Jul 16 13:21:24.431048 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:21:24.431021    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d02fb8_d87f_4902_8759_43f5774d13c7.slice/crio-e35feaad6dce6347b5e022c0a620d5f0cd01a8fa51e210b656785dba01afa05e WatchSource:0}: Error finding container e35feaad6dce6347b5e022c0a620d5f0cd01a8fa51e210b656785dba01afa05e: Status 404 returned error can't find the container with id e35feaad6dce6347b5e022c0a620d5f0cd01a8fa51e210b656785dba01afa05e
Jul 16 13:21:25.276188 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:25.276148    2564 generic.go:356] "Generic (PLEG): container finished" podID="03d02fb8-d87f-4902-8759-43f5774d13c7" containerID="398b35a5f7e72e649fcdaaae5436ee0c4664902a00d5d1a83108e3d44e756a05" exitCode=0
Jul 16 13:21:25.276622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:25.276234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2" event={"ID":"03d02fb8-d87f-4902-8759-43f5774d13c7","Type":"ContainerDied","Data":"398b35a5f7e72e649fcdaaae5436ee0c4664902a00d5d1a83108e3d44e756a05"}
Jul 16 13:21:25.276622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:25.276289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2" event={"ID":"03d02fb8-d87f-4902-8759-43f5774d13c7","Type":"ContainerStarted","Data":"e35feaad6dce6347b5e022c0a620d5f0cd01a8fa51e210b656785dba01afa05e"}
Jul 16 13:21:26.419467 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:26.419442    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"
Jul 16 13:21:26.596481 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:26.596452    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03d02fb8-d87f-4902-8759-43f5774d13c7-maas-api-service-ca\") pod \"03d02fb8-d87f-4902-8759-43f5774d13c7\" (UID: \"03d02fb8-d87f-4902-8759-43f5774d13c7\") "
Jul 16 13:21:26.596830 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:26.596808    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d02fb8-d87f-4902-8759-43f5774d13c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03d02fb8-d87f-4902-8759-43f5774d13c7" (UID: "03d02fb8-d87f-4902-8759-43f5774d13c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:21:26.697301 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:26.697264    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03d02fb8-d87f-4902-8759-43f5774d13c7-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:21:27.287170 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:27.287137    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2"
Jul 16 13:21:27.287170 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:27.287149    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2" event={"ID":"03d02fb8-d87f-4902-8759-43f5774d13c7","Type":"ContainerDied","Data":"e35feaad6dce6347b5e022c0a620d5f0cd01a8fa51e210b656785dba01afa05e"}
Jul 16 13:21:27.287435 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:27.287204    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e35feaad6dce6347b5e022c0a620d5f0cd01a8fa51e210b656785dba01afa05e"
Jul 16 13:21:34.476412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.476365    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"]
Jul 16 13:21:34.476899 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.476673    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5" podUID="8065d731-f6be-47c3-be08-1d4bae49fac4" containerName="maas-api" containerID="cri-o://e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668" gracePeriod=30
Jul 16 13:21:34.499524 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.499489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:21:34.734631 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.734557    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:21:34.772432 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.772395    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmkbr\" (UniqueName: \"kubernetes.io/projected/8065d731-f6be-47c3-be08-1d4bae49fac4-kube-api-access-nmkbr\") pod \"8065d731-f6be-47c3-be08-1d4bae49fac4\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") "
Jul 16 13:21:34.772614 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.772454    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls\") pod \"8065d731-f6be-47c3-be08-1d4bae49fac4\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") "
Jul 16 13:21:34.772614 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.772477    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8065d731-f6be-47c3-be08-1d4bae49fac4-openshift-service-ca\") pod \"8065d731-f6be-47c3-be08-1d4bae49fac4\" (UID: \"8065d731-f6be-47c3-be08-1d4bae49fac4\") "
Jul 16 13:21:34.772897 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.772866    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8065d731-f6be-47c3-be08-1d4bae49fac4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8065d731-f6be-47c3-be08-1d4bae49fac4" (UID: "8065d731-f6be-47c3-be08-1d4bae49fac4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:21:34.774615 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.774587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8065d731-f6be-47c3-be08-1d4bae49fac4-kube-api-access-nmkbr" (OuterVolumeSpecName: "kube-api-access-nmkbr") pod "8065d731-f6be-47c3-be08-1d4bae49fac4" (UID: "8065d731-f6be-47c3-be08-1d4bae49fac4"). InnerVolumeSpecName "kube-api-access-nmkbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:21:34.774726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.774587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8065d731-f6be-47c3-be08-1d4bae49fac4" (UID: "8065d731-f6be-47c3-be08-1d4bae49fac4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:21:34.873555 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.873520    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8065d731-f6be-47c3-be08-1d4bae49fac4-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:21:34.873555 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.873554    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8065d731-f6be-47c3-be08-1d4bae49fac4-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:21:34.873747 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:34.873563    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmkbr\" (UniqueName: \"kubernetes.io/projected/8065d731-f6be-47c3-be08-1d4bae49fac4-kube-api-access-nmkbr\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:21:35.333502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.333469    2564 generic.go:356] "Generic (PLEG): container finished" podID="8065d731-f6be-47c3-be08-1d4bae49fac4" containerID="e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668" exitCode=0
Jul 16 13:21:35.333679 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.333513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5" event={"ID":"8065d731-f6be-47c3-be08-1d4bae49fac4","Type":"ContainerDied","Data":"e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668"}
Jul 16 13:21:35.333679 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.333531    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"
Jul 16 13:21:35.333679 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.333557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5" event={"ID":"8065d731-f6be-47c3-be08-1d4bae49fac4","Type":"ContainerDied","Data":"180849b98de466448dee2482bd628b6d5ad67af38f2df1276e9320521cc1631f"}
Jul 16 13:21:35.333679 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.333578    2564 scope.go:117] "RemoveContainer" containerID="e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668"
Jul 16 13:21:35.342374 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.342351    2564 scope.go:117] "RemoveContainer" containerID="e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668"
Jul 16 13:21:35.342625 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:21:35.342606    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668\": container with ID starting with e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668 not found: ID does not exist" containerID="e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668"
Jul 16 13:21:35.342664 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.342635    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668"} err="failed to get container status \"e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668\": rpc error: code = NotFound desc = could not find container \"e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668\": container with ID starting with e04d50d6bc3366a2767e12b9e94bf2fd69dea6aedf90a0a27c4e4253655b9668 not found: ID does not exist"
Jul 16 13:21:35.352163 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.352138    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"]
Jul 16 13:21:35.356878 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:35.356855    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1f86fcf-5b6b84b47d-tldg5"]
Jul 16 13:21:36.835084 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:36.835041    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8065d731-f6be-47c3-be08-1d4bae49fac4" path="/var/lib/kubelet/pods/8065d731-f6be-47c3-be08-1d4bae49fac4/volumes"
Jul 16 13:21:39.118167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:39.118103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:21:44.134593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:21:44.134551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:04.081156 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:04.081101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:04.182274 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:04.182244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:21.764153 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:21.764121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:22.210700 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:22.210671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:28.407290 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:28.407256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:43.805073 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:43.805042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:43.873565 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:43.873534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:51.460887 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:51.460845    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"]
Jul 16 13:22:51.461326 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:51.461079    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy" containerID="cri-o://6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a" gracePeriod=30
Jul 16 13:22:51.503080 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:51.503045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:51.696497 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:51.696464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:52.794400 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:52.794371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:52.888726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:52.888695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:52.992564 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:52.992529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:53.731544 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:53.731504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:53.821987 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:53.821945    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:53.931206 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:53.931168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:55.356474 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:55.356429    2564 patch_prober.go:28] interesting pod/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 13:22:55.356874 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:55.356508    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 13:22:55.371575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:55.371549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:22:56.715322 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.715291    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:22:56.760527 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.760442    2564 generic.go:356] "Generic (PLEG): container finished" podID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerID="6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a" exitCode=0
Jul 16 13:22:56.760527 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.760494    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"
Jul 16 13:22:56.760726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.760523    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" event={"ID":"bdc7d44a-4ea2-4327-81b1-776984c5660b","Type":"ContainerDied","Data":"6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a"}
Jul 16 13:22:56.760726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.760587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5" event={"ID":"bdc7d44a-4ea2-4327-81b1-776984c5660b","Type":"ContainerDied","Data":"d1bd3fe96371ab10cf7cc6081471d19d2e9a77d26bdef6d0285ab859923c286e"}
Jul 16 13:22:56.760726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.760613    2564 scope.go:117] "RemoveContainer" containerID="6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a"
Jul 16 13:22:56.760931 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.760911    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-certs\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.760994 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.760969    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc7d44a-4ea2-4327-81b1-776984c5660b-istiod-ca-cert\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761048 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjkdh\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-kube-api-access-bjkdh\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761102 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761049    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-token\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761102 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761082    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-podinfo\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761231 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761141    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-socket\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761286 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761231    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-credential-socket\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761286 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761248    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:22:56.761286 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761273    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-data\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761437 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761308    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-envoy\") pod \"bdc7d44a-4ea2-4327-81b1-776984c5660b\" (UID: \"bdc7d44a-4ea2-4327-81b1-776984c5660b\") "
Jul 16 13:22:56.761437 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761367    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc7d44a-4ea2-4327-81b1-776984c5660b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:22:56.761537 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761452    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:22:56.761632 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761607    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.761632 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761635    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.761901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761649    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc7d44a-4ea2-4327-81b1-776984c5660b-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.761901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.761833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:22:56.762653 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.762629    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:22:56.763651 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.763626    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:22:56.763898 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.763879    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:22:56.763965 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.763884    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:22:56.764077 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.764059    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-kube-api-access-bjkdh" (OuterVolumeSpecName: "kube-api-access-bjkdh") pod "bdc7d44a-4ea2-4327-81b1-776984c5660b" (UID: "bdc7d44a-4ea2-4327-81b1-776984c5660b"). InnerVolumeSpecName "kube-api-access-bjkdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:22:56.781358 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.781338    2564 scope.go:117] "RemoveContainer" containerID="010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce"
Jul 16 13:22:56.789049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.789032    2564 scope.go:117] "RemoveContainer" containerID="6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a"
Jul 16 13:22:56.789304 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:22:56.789283    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a\": container with ID starting with 6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a not found: ID does not exist" containerID="6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a"
Jul 16 13:22:56.789378 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.789315    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a"} err="failed to get container status \"6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a\": rpc error: code = NotFound desc = could not find container \"6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a\": container with ID starting with 6bdda7574cd818c9edba055ec6f394c5d67ea6d00533e7a0a5479f9f222b771a not found: ID does not exist"
Jul 16 13:22:56.789378 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.789335    2564 scope.go:117] "RemoveContainer" containerID="010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce"
Jul 16 13:22:56.789595 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:22:56.789577    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce\": container with ID starting with 010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce not found: ID does not exist" containerID="010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce"
Jul 16 13:22:56.789636 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.789601    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce"} err="failed to get container status \"010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce\": rpc error: code = NotFound desc = could not find container \"010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce\": container with ID starting with 010e1a38c3b052b4247b261e8646242a82934264acb1daf40a4fa86552f6a4ce not found: ID does not exist"
Jul 16 13:22:56.862907 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.862872    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.862907 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.862903    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.863082 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.862915    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.863082 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.862924    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.863082 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.862933    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjkdh\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-kube-api-access-bjkdh\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:56.863082 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:56.862942    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc7d44a-4ea2-4327-81b1-776984c5660b-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:22:57.080068 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:57.079980    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"]
Jul 16 13:22:57.085346 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:57.085317    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a1f86fcf-openshift-default-6fdd8f4d7-v9rc5"]
Jul 16 13:22:58.834031 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:22:58.833987    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" path="/var/lib/kubelet/pods/bdc7d44a-4ea2-4327-81b1-776984c5660b/volumes"
Jul 16 13:23:01.970275 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:01.970237    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:02.065571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:02.065506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:02.862488 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:02.862451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:09.592082 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:09.592034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:09.700832 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:09.700788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:09.791564 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:09.791526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:17.005876 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:17.005842    2564 scope.go:117] "RemoveContainer" containerID="6c40e43a96d0f9cb3afc6dff3df69c0355ce0d27a7cc07c2a044ce4fe696a9a7"
Jul 16 13:23:20.325126 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:20.325079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:20.685663 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:20.685628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:27.509228 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:27.509197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:41.681237 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:41.681201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:48.343042 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:48.343008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:48.444789 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:48.444758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:48.713696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:48.713611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:49.020522 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020444    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"]
Jul 16 13:23:49.020811 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020799    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy"
Jul 16 13:23:49.020854 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020812    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy"
Jul 16 13:23:49.020854 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020833    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8065d731-f6be-47c3-be08-1d4bae49fac4" containerName="maas-api"
Jul 16 13:23:49.020854 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020839    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8065d731-f6be-47c3-be08-1d4bae49fac4" containerName="maas-api"
Jul 16 13:23:49.020854 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020853    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d02fb8-d87f-4902-8759-43f5774d13c7" containerName="revoke-keys"
Jul 16 13:23:49.020980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020860    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d02fb8-d87f-4902-8759-43f5774d13c7" containerName="revoke-keys"
Jul 16 13:23:49.020980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020912    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d02fb8-d87f-4902-8759-43f5774d13c7" containerName="revoke-keys"
Jul 16 13:23:49.020980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020921    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy"
Jul 16 13:23:49.020980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020929    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8065d731-f6be-47c3-be08-1d4bae49fac4" containerName="maas-api"
Jul 16 13:23:49.020980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.020936    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy"
Jul 16 13:23:49.024091 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.024071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.026990 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.026968    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-00668a-openshift-default-dockercfg-tqzcx\""
Jul 16 13:23:49.041690 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.041662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"]
Jul 16 13:23:49.067407 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.067370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:49.132995 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.132958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-token\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.132995 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-socket\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.133262 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-data\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.133262 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-podinfo\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.133262 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6167098b-aa92-43a4-8d8a-c8949898e8ff-istiod-ca-cert\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.133262 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbqk8\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-kube-api-access-bbqk8\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.133262 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-certs\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.133423 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-envoy\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.133423 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.133303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-credential-socket\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.233936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.233900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbqk8\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-kube-api-access-bbqk8\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.233936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.233942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-certs\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234220 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.233986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-envoy\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234220 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-credential-socket\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234220 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-token\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234220 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-socket\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234220 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-data\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234509 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-podinfo\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234509 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6167098b-aa92-43a4-8d8a-c8949898e8ff-istiod-ca-cert\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234509 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-certs\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234509 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-credential-socket\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-socket\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-data\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.234914 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.234894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6167098b-aa92-43a4-8d8a-c8949898e8ff-istiod-ca-cert\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.236706 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.236687    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-envoy\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.237022 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.237004    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-podinfo\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.243491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.243465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbqk8\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-kube-api-access-bbqk8\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.243613 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.243472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-token\") pod \"e2e-inf-a-00668a-openshift-default-79b859c95-v45ql\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") " pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.336894 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.336862    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:49.380925 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.380891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:49.488851 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.488820    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"]
Jul 16 13:23:49.489486 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:23:49.489457    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6167098b_aa92_43a4_8d8a_c8949898e8ff.slice/crio-be94ad7aa22483466e602b1af19161d7211f6ad79fa09bb958c1ac6526f0394a WatchSource:0}: Error finding container be94ad7aa22483466e602b1af19161d7211f6ad79fa09bb958c1ac6526f0394a: Status 404 returned error can't find the container with id be94ad7aa22483466e602b1af19161d7211f6ad79fa09bb958c1ac6526f0394a
Jul 16 13:23:49.491636 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.491605    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:23:49.491705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.491670    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:23:49.491705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:49.491700    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:23:50.041621 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:50.041563    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" event={"ID":"6167098b-aa92-43a4-8d8a-c8949898e8ff","Type":"ContainerStarted","Data":"fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5"}
Jul 16 13:23:50.041843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:50.041683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" event={"ID":"6167098b-aa92-43a4-8d8a-c8949898e8ff","Type":"ContainerStarted","Data":"be94ad7aa22483466e602b1af19161d7211f6ad79fa09bb958c1ac6526f0394a"}
Jul 16 13:23:50.066342 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:50.066285    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" podStartSLOduration=2.06627124 podStartE2EDuration="2.06627124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:23:50.065817991 +0000 UTC m=+2313.804807761" watchObservedRunningTime="2026-07-16 13:23:50.06627124 +0000 UTC m=+2313.805261020"
Jul 16 13:23:50.337415 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:50.337385    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:50.342189 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:50.342161    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:51.048149 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:51.048096    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:51.049342 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:51.049312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:23:52.014551 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.014507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:52.104377 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.104336    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"]
Jul 16 13:23:52.104905 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.104880    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy"
Jul 16 13:23:52.104905 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.104904    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc7d44a-4ea2-4327-81b1-776984c5660b" containerName="istio-proxy"
Jul 16 13:23:52.108299 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.108277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.110946 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.110922    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-00668a-serving-cert\""
Jul 16 13:23:52.121216 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.121190    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"]
Jul 16 13:23:52.124523 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.124495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:52.217002 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.216972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:52.261696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.261658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.261883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.261739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48lwb\" (UniqueName: \"kubernetes.io/projected/7ac6dbea-0ed9-4136-9514-933b503c4874-kube-api-access-48lwb\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.261883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.261776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac6dbea-0ed9-4136-9514-933b503c4874-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.362928 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.362885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48lwb\" (UniqueName: \"kubernetes.io/projected/7ac6dbea-0ed9-4136-9514-933b503c4874-kube-api-access-48lwb\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.363140 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.362939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac6dbea-0ed9-4136-9514-933b503c4874-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.363140 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.362973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.363140 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:23:52.363097    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-serving-cert: secret "maas-api-e2e-inf-a-00668a-serving-cert" not found
Jul 16 13:23:52.363287 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:23:52.363193    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls podName:7ac6dbea-0ed9-4136-9514-933b503c4874 nodeName:}" failed. No retries permitted until 2026-07-16 13:23:52.863173764 +0000 UTC m=+2316.602163521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls") pod "maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf" (UID: "7ac6dbea-0ed9-4136-9514-933b503c4874") : secret "maas-api-e2e-inf-a-00668a-serving-cert" not found
Jul 16 13:23:52.363700 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.363679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac6dbea-0ed9-4136-9514-933b503c4874-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.374835 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.374805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48lwb\" (UniqueName: \"kubernetes.io/projected/7ac6dbea-0ed9-4136-9514-933b503c4874-kube-api-access-48lwb\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.783758 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.783665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:52.868275 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.868231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:52.871555 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:52.871516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls\") pod \"maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:53.021813 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:53.021778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:53.022722 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:53.022699    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:53.160789 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:53.160687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:53.176020 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:53.175995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"]
Jul 16 13:23:53.177488 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:23:53.177465    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac6dbea_0ed9_4136_9514_933b503c4874.slice/crio-14fc20c2dfdcd787b2152bd023cd25b17645b2acb1e431c7c6575dcdca29316a WatchSource:0}: Error finding container 14fc20c2dfdcd787b2152bd023cd25b17645b2acb1e431c7c6575dcdca29316a: Status 404 returned error can't find the container with id 14fc20c2dfdcd787b2152bd023cd25b17645b2acb1e431c7c6575dcdca29316a
Jul 16 13:23:54.075955 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:54.075917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf" event={"ID":"7ac6dbea-0ed9-4136-9514-933b503c4874","Type":"ContainerStarted","Data":"26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c"}
Jul 16 13:23:54.076213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:54.075994    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf" event={"ID":"7ac6dbea-0ed9-4136-9514-933b503c4874","Type":"ContainerStarted","Data":"14fc20c2dfdcd787b2152bd023cd25b17645b2acb1e431c7c6575dcdca29316a"}
Jul 16 13:23:54.076213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:54.076018    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:23:54.095972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:54.095920    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf" podStartSLOduration=1.690199252 podStartE2EDuration="2.095904309s" totalImagesPullingTime="405.705057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:23:54.094757203 +0000 UTC m=+2317.833746982" watchObservedRunningTime="2026-07-16 13:23:54.095904309 +0000 UTC m=+2317.834894099"
Jul 16 13:23:56.529628 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:56.529593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:56.887387 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:56.887352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:57.172731 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.172637    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"]
Jul 16 13:23:57.176421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.176403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.179004 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.178981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ab35b1-openshift-default-dockercfg-wdsn4\""
Jul 16 13:23:57.188170 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.188120    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"]
Jul 16 13:23:57.254828 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.254794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:57.307763 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.307713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-envoy\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.307937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.307771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qqq\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-kube-api-access-42qqq\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.307937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.307834    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-token\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.307937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.307903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-credential-socket\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.307937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.307933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-certs\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.308092 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.307966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istiod-ca-cert\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.308092 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.308059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-data\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.308185 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.308101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-podinfo\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.308185 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.308177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-socket\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409353 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-socket\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409546 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-envoy\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409546 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qqq\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-kube-api-access-42qqq\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409546 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-token\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409546 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-credential-socket\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409546 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-certs\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409876 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409841    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-socket\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.409947 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.409928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-credential-socket\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.410021 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.410000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istiod-ca-cert\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.410081 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.410069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-data\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.410160 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.410079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-certs\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.410160 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.410102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-podinfo\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.410375 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.410353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istiod-ca-cert\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.410425 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.410377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-data\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.411796 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.411771    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-envoy\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.412375 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.412357    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-podinfo\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.418435 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.418405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-token\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.418647 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.418627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qqq\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-kube-api-access-42qqq\") pod \"e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") " pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.489620 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.489511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:57.645660 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.645622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"]
Jul 16 13:23:57.647011 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:23:57.646979    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e82e3d_fe0a_408f_aac1_59ae18ab58df.slice/crio-1c31f5c3cb1b51a6f89a25fd403cfe1de621048c94f30566f393b46d2e8744ad WatchSource:0}: Error finding container 1c31f5c3cb1b51a6f89a25fd403cfe1de621048c94f30566f393b46d2e8744ad: Status 404 returned error can't find the container with id 1c31f5c3cb1b51a6f89a25fd403cfe1de621048c94f30566f393b46d2e8744ad
Jul 16 13:23:57.649372 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.649195    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:23:57.649372 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.649303    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:23:57.649372 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.649354    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:23:57.694128 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:57.694084    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:23:58.098976 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:58.098943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" event={"ID":"c8e82e3d-fe0a-408f-aac1-59ae18ab58df","Type":"ContainerStarted","Data":"bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e"}
Jul 16 13:23:58.099204 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:58.098995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" event={"ID":"c8e82e3d-fe0a-408f-aac1-59ae18ab58df","Type":"ContainerStarted","Data":"1c31f5c3cb1b51a6f89a25fd403cfe1de621048c94f30566f393b46d2e8744ad"}
Jul 16 13:23:58.122095 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:58.122043    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" podStartSLOduration=1.12202083 podStartE2EDuration="1.12202083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:23:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:23:58.119963172 +0000 UTC m=+2321.858952951" watchObservedRunningTime="2026-07-16 13:23:58.12202083 +0000 UTC m=+2321.861010608"
Jul 16 13:23:58.490343 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:58.490258    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:58.495589 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:58.495554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:59.104141 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:59.104086    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:23:59.105019 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:23:59.104997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:24:00.086149 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.086093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:24:00.160540 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.160488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:00.259604 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.259570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:00.410435 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.410351    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"]
Jul 16 13:24:00.414682 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.414659    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.417638 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.417612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ab35b1-serving-cert\""
Jul 16 13:24:00.427089 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.427063    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"]
Jul 16 13:24:00.473094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.473063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:00.540566 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.540532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p95wh\" (UniqueName: \"kubernetes.io/projected/268b300e-3626-4288-8da8-b2eb1a3d3a0b-kube-api-access-p95wh\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.540566 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.540577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/268b300e-3626-4288-8da8-b2eb1a3d3a0b-maas-api-tls\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.540800 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.540595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/268b300e-3626-4288-8da8-b2eb1a3d3a0b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.639479 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.639435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:00.641643 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.641621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p95wh\" (UniqueName: \"kubernetes.io/projected/268b300e-3626-4288-8da8-b2eb1a3d3a0b-kube-api-access-p95wh\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.641709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.641663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/268b300e-3626-4288-8da8-b2eb1a3d3a0b-maas-api-tls\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.641709 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.641680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/268b300e-3626-4288-8da8-b2eb1a3d3a0b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.642366 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.642343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/268b300e-3626-4288-8da8-b2eb1a3d3a0b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.644167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.644148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/268b300e-3626-4288-8da8-b2eb1a3d3a0b-maas-api-tls\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.651323 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.651301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p95wh\" (UniqueName: \"kubernetes.io/projected/268b300e-3626-4288-8da8-b2eb1a3d3a0b-kube-api-access-p95wh\") pod \"maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.727485 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.727396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:00.880856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:00.880830    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"]
Jul 16 13:24:00.882662 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:24:00.882634    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268b300e_3626_4288_8da8_b2eb1a3d3a0b.slice/crio-3aa82eb73b10944da9e4384c606bf2634d110ac9556ccfd27ab5a7f613d26f0d WatchSource:0}: Error finding container 3aa82eb73b10944da9e4384c606bf2634d110ac9556ccfd27ab5a7f613d26f0d: Status 404 returned error can't find the container with id 3aa82eb73b10944da9e4384c606bf2634d110ac9556ccfd27ab5a7f613d26f0d
Jul 16 13:24:01.022623 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:01.022541    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:01.116384 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:01.116346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4" event={"ID":"268b300e-3626-4288-8da8-b2eb1a3d3a0b","Type":"ContainerStarted","Data":"3aa82eb73b10944da9e4384c606bf2634d110ac9556ccfd27ab5a7f613d26f0d"}
Jul 16 13:24:01.121270 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:01.121245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:02.126675 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:02.126635    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4" event={"ID":"268b300e-3626-4288-8da8-b2eb1a3d3a0b","Type":"ContainerStarted","Data":"d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e"}
Jul 16 13:24:02.127770 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:02.127743    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:02.148552 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:02.148483    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4" podStartSLOduration=1.647535125 podStartE2EDuration="2.148458033s" totalImagesPullingTime="500.922908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:24:02.144665042 +0000 UTC m=+2325.883654823" watchObservedRunningTime="2026-07-16 13:24:02.148458033 +0000 UTC m=+2325.887447813"
Jul 16 13:24:04.592409 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:04.592344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:08.140784 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:08.140750    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:24:09.176826 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:09.176796    2564 generic.go:356] "Generic (PLEG): container finished" podID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerID="fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5" exitCode=0
Jul 16 13:24:09.177234 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:09.176871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" event={"ID":"6167098b-aa92-43a4-8d8a-c8949898e8ff","Type":"ContainerDied","Data":"fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5"}
Jul 16 13:24:09.177277 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:09.177249    2564 scope.go:117] "RemoveContainer" containerID="fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5"
Jul 16 13:24:09.178326 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:09.178298    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:24:09.178397 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:09.178383    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:24:09.178443 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:09.178427    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:24:10.187900 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:10.187861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" event={"ID":"6167098b-aa92-43a4-8d8a-c8949898e8ff","Type":"ContainerStarted","Data":"bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63"}
Jul 16 13:24:10.337638 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:10.337605    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:24:10.337984 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:10.337929    2564 patch_prober.go:28] interesting pod/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 16 13:24:10.338089 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:10.338033    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 16 13:24:11.337787 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:11.337738    2564 patch_prober.go:28] interesting pod/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 16 13:24:11.338434 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:11.338377    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 16 13:24:12.338267 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:12.338222    2564 patch_prober.go:28] interesting pod/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 16 13:24:12.338788 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:12.338306    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 16 13:24:13.338445 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:13.337983    2564 patch_prober.go:28] interesting pod/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 16 13:24:13.338445 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:13.338046    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 16 13:24:14.061281 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:14.061239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:14.160507 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:14.160474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:14.338219 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:14.338178    2564 patch_prober.go:28] interesting pod/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 16 13:24:14.338425 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:14.338246    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 16 13:24:15.342204 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:15.342174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:24:15.342602 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:15.342572    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:24:15.343470 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:15.343448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:24:17.224783 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:17.224664    2564 generic.go:356] "Generic (PLEG): container finished" podID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerID="bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e" exitCode=0
Jul 16 13:24:17.224783 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:17.224733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" event={"ID":"c8e82e3d-fe0a-408f-aac1-59ae18ab58df","Type":"ContainerDied","Data":"bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e"}
Jul 16 13:24:17.225355 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:17.225184    2564 scope.go:117] "RemoveContainer" containerID="bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e"
Jul 16 13:24:17.226368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:17.226335    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:24:17.226451 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:17.226421    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:24:17.226488 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:17.226462    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:24:18.234493 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:18.234456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" event={"ID":"c8e82e3d-fe0a-408f-aac1-59ae18ab58df","Type":"ContainerStarted","Data":"96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0"}
Jul 16 13:24:18.490270 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:18.490172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:24:18.490503 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:18.490476    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 13:24:18.490553 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:18.490534    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 13:24:19.490331 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:19.490290    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 13:24:19.490873 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:19.490356    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 13:24:20.490481 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:20.490445    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 13:24:20.490908 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:20.490499    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 13:24:21.033959 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:21.033884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:21.489904 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:21.489868    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 13:24:21.490078 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:21.489940    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 13:24:21.983540 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:21.983484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:22.081626 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:22.081590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:22.496099 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:22.496062    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:24:22.496495 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:22.496463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:24:22.497242 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:22.497218    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:24:37.225586 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:37.225543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:37.325631 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:37.325587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:24:45.380653 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:24:45.380625    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:04.915141 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:04.915089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:08.481860 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:08.481826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:09.487983 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:09.487946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:10.133525 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:10.133486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:10.234454 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:10.234422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:12.786192 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:12.786153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:12.887592 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:12.887544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:20.161710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.161673    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"]
Jul 16 13:25:20.162094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.161913    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf" podUID="7ac6dbea-0ed9-4136-9514-933b503c4874" containerName="maas-api" containerID="cri-o://26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c" gracePeriod=30
Jul 16 13:25:20.201016 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.200975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:20.428777 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.428753    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:25:20.485304 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.485274    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48lwb\" (UniqueName: \"kubernetes.io/projected/7ac6dbea-0ed9-4136-9514-933b503c4874-kube-api-access-48lwb\") pod \"7ac6dbea-0ed9-4136-9514-933b503c4874\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") "
Jul 16 13:25:20.485471 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.485351    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac6dbea-0ed9-4136-9514-933b503c4874-openshift-service-ca\") pod \"7ac6dbea-0ed9-4136-9514-933b503c4874\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") "
Jul 16 13:25:20.485471 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.485374    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls\") pod \"7ac6dbea-0ed9-4136-9514-933b503c4874\" (UID: \"7ac6dbea-0ed9-4136-9514-933b503c4874\") "
Jul 16 13:25:20.485733 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.485703    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ac6dbea-0ed9-4136-9514-933b503c4874-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ac6dbea-0ed9-4136-9514-933b503c4874" (UID: "7ac6dbea-0ed9-4136-9514-933b503c4874"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:25:20.487456 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.487427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac6dbea-0ed9-4136-9514-933b503c4874-kube-api-access-48lwb" (OuterVolumeSpecName: "kube-api-access-48lwb") pod "7ac6dbea-0ed9-4136-9514-933b503c4874" (UID: "7ac6dbea-0ed9-4136-9514-933b503c4874"). InnerVolumeSpecName "kube-api-access-48lwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:25:20.487581 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.487438    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ac6dbea-0ed9-4136-9514-933b503c4874" (UID: "7ac6dbea-0ed9-4136-9514-933b503c4874"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:25:20.570937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.570903    2564 generic.go:356] "Generic (PLEG): container finished" podID="7ac6dbea-0ed9-4136-9514-933b503c4874" containerID="26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c" exitCode=0
Jul 16 13:25:20.571139 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.570951    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"
Jul 16 13:25:20.571139 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.570995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf" event={"ID":"7ac6dbea-0ed9-4136-9514-933b503c4874","Type":"ContainerDied","Data":"26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c"}
Jul 16 13:25:20.571139 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.571048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf" event={"ID":"7ac6dbea-0ed9-4136-9514-933b503c4874","Type":"ContainerDied","Data":"14fc20c2dfdcd787b2152bd023cd25b17645b2acb1e431c7c6575dcdca29316a"}
Jul 16 13:25:20.571139 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.571071    2564 scope.go:117] "RemoveContainer" containerID="26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c"
Jul 16 13:25:20.580939 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.580920    2564 scope.go:117] "RemoveContainer" containerID="26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c"
Jul 16 13:25:20.581233 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:25:20.581213    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c\": container with ID starting with 26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c not found: ID does not exist" containerID="26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c"
Jul 16 13:25:20.581301 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.581249    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c"} err="failed to get container status \"26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c\": rpc error: code = NotFound desc = could not find container \"26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c\": container with ID starting with 26f94d7a3364f698d2bc4252d8037be66fca9581143da7d9d90008452c09133c not found: ID does not exist"
Jul 16 13:25:20.586094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.586074    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48lwb\" (UniqueName: \"kubernetes.io/projected/7ac6dbea-0ed9-4136-9514-933b503c4874-kube-api-access-48lwb\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:20.586094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.586095    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac6dbea-0ed9-4136-9514-933b503c4874-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:20.586288 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.586118    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac6dbea-0ed9-4136-9514-933b503c4874-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:20.607671 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.607643    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"]
Jul 16 13:25:20.614962 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.614936    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00668a-7547cfd9d6-6dtrf"]
Jul 16 13:25:20.836488 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:20.836464    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ac6dbea-0ed9-4136-9514-933b503c4874" path="/var/lib/kubelet/pods/7ac6dbea-0ed9-4136-9514-933b503c4874/volumes"
Jul 16 13:25:24.728269 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:24.728225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:31.178786 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:31.178750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:31.254897 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:31.254849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:33.853384 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:33.853328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:35.372959 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:35.372927    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"]
Jul 16 13:25:35.373414 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:35.373153    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy" containerID="cri-o://bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63" gracePeriod=30
Jul 16 13:25:35.398741 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:35.398714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:35.808175 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:35.808071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:36.429636 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:36.429597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:36.529589 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:36.529543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:40.618798 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.618771    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:25:40.673955 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.673871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-data\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.673955 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.673909    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-certs\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.673955 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.673943    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6167098b-aa92-43a4-8d8a-c8949898e8ff-istiod-ca-cert\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.674293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.673964    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-envoy\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.674293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.673994    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-podinfo\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.674293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674012    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbqk8\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-kube-api-access-bbqk8\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.674293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-token\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.674293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-credential-socket\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.674293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674099    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-socket\") pod \"6167098b-aa92-43a4-8d8a-c8949898e8ff\" (UID: \"6167098b-aa92-43a4-8d8a-c8949898e8ff\") "
Jul 16 13:25:40.674293 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674192    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:25:40.674695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674354    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6167098b-aa92-43a4-8d8a-c8949898e8ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:25:40.674695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674406    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.674695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674452    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:25:40.674695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674616    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:25:40.674928 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.674902    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:25:40.676364 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.676324    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:25:40.676364 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.676359    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:25:40.676610 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.676592    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:25:40.676610 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.676603    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-kube-api-access-bbqk8" (OuterVolumeSpecName: "kube-api-access-bbqk8") pod "6167098b-aa92-43a4-8d8a-c8949898e8ff" (UID: "6167098b-aa92-43a4-8d8a-c8949898e8ff"). InnerVolumeSpecName "kube-api-access-bbqk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:25:40.685756 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.685729    2564 generic.go:356] "Generic (PLEG): container finished" podID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerID="bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63" exitCode=0
Jul 16 13:25:40.685859 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.685784    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"
Jul 16 13:25:40.685859 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.685810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" event={"ID":"6167098b-aa92-43a4-8d8a-c8949898e8ff","Type":"ContainerDied","Data":"bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63"}
Jul 16 13:25:40.685937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.685874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql" event={"ID":"6167098b-aa92-43a4-8d8a-c8949898e8ff","Type":"ContainerDied","Data":"be94ad7aa22483466e602b1af19161d7211f6ad79fa09bb958c1ac6526f0394a"}
Jul 16 13:25:40.685937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.685906    2564 scope.go:117] "RemoveContainer" containerID="bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63"
Jul 16 13:25:40.696026 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.696006    2564 scope.go:117] "RemoveContainer" containerID="fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5"
Jul 16 13:25:40.703866 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.703850    2564 scope.go:117] "RemoveContainer" containerID="bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63"
Jul 16 13:25:40.704146 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:25:40.704125    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63\": container with ID starting with bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63 not found: ID does not exist" containerID="bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63"
Jul 16 13:25:40.704191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.704154    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63"} err="failed to get container status \"bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63\": rpc error: code = NotFound desc = could not find container \"bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63\": container with ID starting with bdf96600e9019a343b5e924125f8056534c818fddd1803cd3f6db4097d924d63 not found: ID does not exist"
Jul 16 13:25:40.704191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.704171    2564 scope.go:117] "RemoveContainer" containerID="fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5"
Jul 16 13:25:40.704410 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:25:40.704394    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5\": container with ID starting with fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5 not found: ID does not exist" containerID="fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5"
Jul 16 13:25:40.704446 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.704416    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5"} err="failed to get container status \"fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5\": rpc error: code = NotFound desc = could not find container \"fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5\": container with ID starting with fc56e7a37189c44fd63e8dfe4109bd6dd07af25bd7859a5eb1569b7e7dffc1c5 not found: ID does not exist"
Jul 16 13:25:40.709167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.709147    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"]
Jul 16 13:25:40.713412 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.713390    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-00668a-openshift-default-79b859c95-v45ql"]
Jul 16 13:25:40.775538 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775515    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.775538 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775535    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6167098b-aa92-43a4-8d8a-c8949898e8ff-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.775538 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775544    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.775730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775563    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.775730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775574    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbqk8\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-kube-api-access-bbqk8\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.775730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775583    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6167098b-aa92-43a4-8d8a-c8949898e8ff-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.775730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775592    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.775730 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.775601    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6167098b-aa92-43a4-8d8a-c8949898e8ff-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:40.834394 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:40.834371    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" path="/var/lib/kubelet/pods/6167098b-aa92-43a4-8d8a-c8949898e8ff/volumes"
Jul 16 13:25:46.226936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.226893    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"]
Jul 16 13:25:46.227441 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.227154    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4" podUID="268b300e-3626-4288-8da8-b2eb1a3d3a0b" containerName="maas-api" containerID="cri-o://d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e" gracePeriod=30
Jul 16 13:25:46.258422 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.258391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:46.485678 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.485608    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:25:46.531290 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.531257    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/268b300e-3626-4288-8da8-b2eb1a3d3a0b-openshift-service-ca\") pod \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") "
Jul 16 13:25:46.531497 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.531357    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/268b300e-3626-4288-8da8-b2eb1a3d3a0b-maas-api-tls\") pod \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") "
Jul 16 13:25:46.531497 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.531390    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p95wh\" (UniqueName: \"kubernetes.io/projected/268b300e-3626-4288-8da8-b2eb1a3d3a0b-kube-api-access-p95wh\") pod \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\" (UID: \"268b300e-3626-4288-8da8-b2eb1a3d3a0b\") "
Jul 16 13:25:46.531651 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.531614    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/268b300e-3626-4288-8da8-b2eb1a3d3a0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "268b300e-3626-4288-8da8-b2eb1a3d3a0b" (UID: "268b300e-3626-4288-8da8-b2eb1a3d3a0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:25:46.531724 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.531707    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/268b300e-3626-4288-8da8-b2eb1a3d3a0b-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:46.533518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.533494    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/268b300e-3626-4288-8da8-b2eb1a3d3a0b-kube-api-access-p95wh" (OuterVolumeSpecName: "kube-api-access-p95wh") pod "268b300e-3626-4288-8da8-b2eb1a3d3a0b" (UID: "268b300e-3626-4288-8da8-b2eb1a3d3a0b"). InnerVolumeSpecName "kube-api-access-p95wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:25:46.533518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.533506    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/268b300e-3626-4288-8da8-b2eb1a3d3a0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "268b300e-3626-4288-8da8-b2eb1a3d3a0b" (UID: "268b300e-3626-4288-8da8-b2eb1a3d3a0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:25:46.632788 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.632756    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/268b300e-3626-4288-8da8-b2eb1a3d3a0b-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:46.632788 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.632786    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p95wh\" (UniqueName: \"kubernetes.io/projected/268b300e-3626-4288-8da8-b2eb1a3d3a0b-kube-api-access-p95wh\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:25:46.716887 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.716849    2564 generic.go:356] "Generic (PLEG): container finished" podID="268b300e-3626-4288-8da8-b2eb1a3d3a0b" containerID="d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e" exitCode=0
Jul 16 13:25:46.717028 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.716898    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"
Jul 16 13:25:46.717028 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.716931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4" event={"ID":"268b300e-3626-4288-8da8-b2eb1a3d3a0b","Type":"ContainerDied","Data":"d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e"}
Jul 16 13:25:46.717028 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.716994    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4" event={"ID":"268b300e-3626-4288-8da8-b2eb1a3d3a0b","Type":"ContainerDied","Data":"3aa82eb73b10944da9e4384c606bf2634d110ac9556ccfd27ab5a7f613d26f0d"}
Jul 16 13:25:46.717028 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.717008    2564 scope.go:117] "RemoveContainer" containerID="d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e"
Jul 16 13:25:46.727329 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.727313    2564 scope.go:117] "RemoveContainer" containerID="d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e"
Jul 16 13:25:46.727581 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:25:46.727562    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e\": container with ID starting with d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e not found: ID does not exist" containerID="d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e"
Jul 16 13:25:46.727659 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.727589    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e"} err="failed to get container status \"d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e\": rpc error: code = NotFound desc = could not find container \"d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e\": container with ID starting with d791b2e8f899de88331268e4857b5b8f0ffef8d58290ac4488f1b88ea9ef3d6e not found: ID does not exist"
Jul 16 13:25:46.740661 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.740595    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"]
Jul 16 13:25:46.745296 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.745273    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ab35b1-8db986988-r8cv4"]
Jul 16 13:25:46.836921 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:46.836884    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="268b300e-3626-4288-8da8-b2eb1a3d3a0b" path="/var/lib/kubelet/pods/268b300e-3626-4288-8da8-b2eb1a3d3a0b/volumes"
Jul 16 13:25:50.858765 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:50.858734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:57.325164 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:57.325130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:25:57.426450 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:25:57.426415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:01.559647 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:01.559614    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"]
Jul 16 13:26:01.560049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:01.559832    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy" containerID="cri-o://96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0" gracePeriod=30
Jul 16 13:26:01.609261 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:01.609223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:01.819006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:01.818922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:02.157673 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.157642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:02.472591 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472512    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"]
Jul 16 13:26:02.472908 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472895    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy"
Jul 16 13:26:02.472972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472909    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy"
Jul 16 13:26:02.472972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472921    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268b300e-3626-4288-8da8-b2eb1a3d3a0b" containerName="maas-api"
Jul 16 13:26:02.472972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472927    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="268b300e-3626-4288-8da8-b2eb1a3d3a0b" containerName="maas-api"
Jul 16 13:26:02.472972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472937    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ac6dbea-0ed9-4136-9514-933b503c4874" containerName="maas-api"
Jul 16 13:26:02.472972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472943    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ac6dbea-0ed9-4136-9514-933b503c4874" containerName="maas-api"
Jul 16 13:26:02.472972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472950    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy"
Jul 16 13:26:02.472972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.472955    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy"
Jul 16 13:26:02.473347 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.473010    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="268b300e-3626-4288-8da8-b2eb1a3d3a0b" containerName="maas-api"
Jul 16 13:26:02.473347 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.473018    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy"
Jul 16 13:26:02.473347 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.473025    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ac6dbea-0ed9-4136-9514-933b503c4874" containerName="maas-api"
Jul 16 13:26:02.473347 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.473032    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6167098b-aa92-43a4-8d8a-c8949898e8ff" containerName="istio-proxy"
Jul 16 13:26:02.476185 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.476166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.478834 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.478815    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-62a003-openshift-default-dockercfg-vhpr7\""
Jul 16 13:26:02.489637 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.489610    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"]
Jul 16 13:26:02.507308 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.507268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:02.580393 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-token\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-certs\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-data\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-socket\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istiod-ca-cert\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq74m\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-kube-api-access-vq74m\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-envoy\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-credential-socket\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.580856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.580720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-podinfo\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681721 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-data\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681721 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-socket\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istiod-ca-cert\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq74m\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-kube-api-access-vq74m\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-envoy\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-credential-socket\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-podinfo\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.681950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-token\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.682276 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.681992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-certs\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.682276 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.682168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-data\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.682276 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.682259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-socket\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.682446 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.682297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-credential-socket\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.682446 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.682318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-certs\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.682557 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.682530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istiod-ca-cert\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.684456 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.684437    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-envoy\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.684696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.684675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-podinfo\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.690696 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.690673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-token\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.690789 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.690675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq74m\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-kube-api-access-vq74m\") pod \"e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") " pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.702583 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.702551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:02.786936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.786851    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:02.931633 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.931604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"]
Jul 16 13:26:02.933764 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:26:02.933738    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc135cdfd_7841_48d8_b2f1_cbb3d9ca3f9c.slice/crio-40fd3e8772d495472693515655e40752f287de2188c9a1e3a55f0eaace28be3d WatchSource:0}: Error finding container 40fd3e8772d495472693515655e40752f287de2188c9a1e3a55f0eaace28be3d: Status 404 returned error can't find the container with id 40fd3e8772d495472693515655e40752f287de2188c9a1e3a55f0eaace28be3d
Jul 16 13:26:02.936345 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.936311    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:02.936445 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.936380    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:02.936445 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:02.936412    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:03.806818 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:03.806781    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" event={"ID":"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c","Type":"ContainerStarted","Data":"e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb"}
Jul 16 13:26:03.807208 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:03.806842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" event={"ID":"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c","Type":"ContainerStarted","Data":"40fd3e8772d495472693515655e40752f287de2188c9a1e3a55f0eaace28be3d"}
Jul 16 13:26:03.830515 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:03.830466    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podStartSLOduration=1.830445551 podStartE2EDuration="1.830445551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:26:03.828390374 +0000 UTC m=+2447.567380170" watchObservedRunningTime="2026-07-16 13:26:03.830445551 +0000 UTC m=+2447.569435337"
Jul 16 13:26:04.787617 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:04.787573    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:04.792611 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:04.792585    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:04.811843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:04.811813    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:04.812653 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:04.812632    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:05.790957 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:05.790924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:05.893418 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:05.893384    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"]
Jul 16 13:26:05.894842 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:05.894819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:05.897386 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:05.897364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:05.899876 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:05.899860    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-62a003-serving-cert\""
Jul 16 13:26:05.910253 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:05.910229    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"]
Jul 16 13:26:05.987052 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:05.987024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:06.012373 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.012328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0030c71-90aa-47cc-85c0-9d433dc486e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.012547 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.012401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwrd\" (UniqueName: \"kubernetes.io/projected/d0030c71-90aa-47cc-85c0-9d433dc486e9-kube-api-access-cpwrd\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.012547 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.012432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0030c71-90aa-47cc-85c0-9d433dc486e9-maas-api-tls\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.112934 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.112899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0030c71-90aa-47cc-85c0-9d433dc486e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.113179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.112960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwrd\" (UniqueName: \"kubernetes.io/projected/d0030c71-90aa-47cc-85c0-9d433dc486e9-kube-api-access-cpwrd\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.113179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.112996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0030c71-90aa-47cc-85c0-9d433dc486e9-maas-api-tls\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.113553 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.113530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0030c71-90aa-47cc-85c0-9d433dc486e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.115347 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.115322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0030c71-90aa-47cc-85c0-9d433dc486e9-maas-api-tls\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.121415 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.121394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwrd\" (UniqueName: \"kubernetes.io/projected/d0030c71-90aa-47cc-85c0-9d433dc486e9-kube-api-access-cpwrd\") pod \"maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.130383 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.130346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:06.209282 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.209253    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:06.378507 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.378480    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"]
Jul 16 13:26:06.380566 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:26:06.380536    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0030c71_90aa_47cc_85c0_9d433dc486e9.slice/crio-b6c23acb03e21b503ffd2574e3fadfaa1f86a970db132892ba6b05a038b4459a WatchSource:0}: Error finding container b6c23acb03e21b503ffd2574e3fadfaa1f86a970db132892ba6b05a038b4459a: Status 404 returned error can't find the container with id b6c23acb03e21b503ffd2574e3fadfaa1f86a970db132892ba6b05a038b4459a
Jul 16 13:26:06.382251 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.382228    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 13:26:06.513038 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.513003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:06.611333 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.611290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:06.823646 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.823620    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:26:06.827424 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.827392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx" event={"ID":"d0030c71-90aa-47cc-85c0-9d433dc486e9","Type":"ContainerStarted","Data":"b6c23acb03e21b503ffd2574e3fadfaa1f86a970db132892ba6b05a038b4459a"}
Jul 16 13:26:06.830468 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.830441    2564 generic.go:356] "Generic (PLEG): container finished" podID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerID="96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0" exitCode=0
Jul 16 13:26:06.830902 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.830766    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"
Jul 16 13:26:06.838135 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.837849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" event={"ID":"c8e82e3d-fe0a-408f-aac1-59ae18ab58df","Type":"ContainerDied","Data":"96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0"}
Jul 16 13:26:06.838135 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.837953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv" event={"ID":"c8e82e3d-fe0a-408f-aac1-59ae18ab58df","Type":"ContainerDied","Data":"1c31f5c3cb1b51a6f89a25fd403cfe1de621048c94f30566f393b46d2e8744ad"}
Jul 16 13:26:06.838135 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.837995    2564 scope.go:117] "RemoveContainer" containerID="96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0"
Jul 16 13:26:06.852299 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.852272    2564 scope.go:117] "RemoveContainer" containerID="bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e"
Jul 16 13:26:06.862878 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.862857    2564 scope.go:117] "RemoveContainer" containerID="96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0"
Jul 16 13:26:06.863179 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:26:06.863149    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0\": container with ID starting with 96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0 not found: ID does not exist" containerID="96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0"
Jul 16 13:26:06.863277 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.863186    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0"} err="failed to get container status \"96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0\": rpc error: code = NotFound desc = could not find container \"96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0\": container with ID starting with 96cbffe4bf6ddb4aef0041edfb2c801f70d4d07e5273b80d78446979d5d707e0 not found: ID does not exist"
Jul 16 13:26:06.863277 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.863205    2564 scope.go:117] "RemoveContainer" containerID="bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e"
Jul 16 13:26:06.863462 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:26:06.863444    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e\": container with ID starting with bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e not found: ID does not exist" containerID="bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e"
Jul 16 13:26:06.863501 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.863467    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e"} err="failed to get container status \"bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e\": rpc error: code = NotFound desc = could not find container \"bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e\": container with ID starting with bc3f9098633e5e043340582a156823b1fcf348ecc526d1affeddf1c78bf29e1e not found: ID does not exist"
Jul 16 13:26:06.920655 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920616    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-envoy\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920688    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-socket\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920734    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42qqq\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-kube-api-access-42qqq\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istiod-ca-cert\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920796    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-credential-socket\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920843    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-data\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920881    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-certs\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920903    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-podinfo\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.920930    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-token\") pod \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\" (UID: \"c8e82e3d-fe0a-408f-aac1-59ae18ab58df\") "
Jul 16 13:26:06.921094 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921008    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:06.921622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:06.921622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:26:06.921622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:06.921622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921549    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:06.921622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921566    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:06.921622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921581    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:06.921622 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921595    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:06.922033 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.921889    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:06.923453 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.923416    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-kube-api-access-42qqq" (OuterVolumeSpecName: "kube-api-access-42qqq") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "kube-api-access-42qqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:26:06.923453 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.923445    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:26:06.923630 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.923475    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:06.923814 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:06.923791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8e82e3d-fe0a-408f-aac1-59ae18ab58df" (UID: "c8e82e3d-fe0a-408f-aac1-59ae18ab58df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:26:07.022502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.022421    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42qqq\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-kube-api-access-42qqq\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:07.022502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.022452    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:07.022502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.022463    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:07.022502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.022471    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:07.022502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.022479    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e82e3d-fe0a-408f-aac1-59ae18ab58df-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:07.154578 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.154542    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"]
Jul 16 13:26:07.159133 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.159092    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ab35b1-openshift-default-5c569f74d7-vkkxv"]
Jul 16 13:26:07.837672 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.837637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx" event={"ID":"d0030c71-90aa-47cc-85c0-9d433dc486e9","Type":"ContainerStarted","Data":"7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e"}
Jul 16 13:26:07.837883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.837726    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:07.858725 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:07.858677    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx" podStartSLOduration=2.214146376 podStartE2EDuration="2.858659303s" totalImagesPullingTime="644.512927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:26:07.857400691 +0000 UTC m=+2451.596390490" watchObservedRunningTime="2026-07-16 13:26:07.858659303 +0000 UTC m=+2451.597649082"
Jul 16 13:26:08.834644 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:08.834610    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" path="/var/lib/kubelet/pods/c8e82e3d-fe0a-408f-aac1-59ae18ab58df/volumes"
Jul 16 13:26:10.298699 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:10.298662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:10.774552 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:10.774510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:11.051158 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.051043    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"]
Jul 16 13:26:11.051950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.051923    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy"
Jul 16 13:26:11.051950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.051949    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy"
Jul 16 13:26:11.052182 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.052066    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy"
Jul 16 13:26:11.052182 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.052077    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy"
Jul 16 13:26:11.055803 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.055783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.058379 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.058359    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c92f28-openshift-default-dockercfg-mbcfq\""
Jul 16 13:26:11.067912 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.067880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"]
Jul 16 13:26:11.080462 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.080422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:11.161502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-podinfo\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-socket\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-token\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-envoy\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-credential-socket\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-certs\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-data\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istiod-ca-cert\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.161980 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.161783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bknm5\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-kube-api-access-bknm5\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263282 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-podinfo\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-socket\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-token\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-envoy\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-credential-socket\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-certs\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-data\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istiod-ca-cert\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263865 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bknm5\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-kube-api-access-bknm5\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263865 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263724    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-socket\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.263865 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-certs\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.264017 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.263984    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-data\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.264091 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.264071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-credential-socket\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.264439 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.264413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istiod-ca-cert\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.265661 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.265637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-envoy\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.265908 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.265893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-podinfo\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.272097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.272066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-token\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.272214 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.272177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bknm5\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-kube-api-access-bknm5\") pod \"e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") " pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.367759 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.367724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:11.433259 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.433195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:11.525350 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.520972    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"]
Jul 16 13:26:11.525350 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.525285    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:11.525471 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.525451    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:11.526441 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.525539    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:11.860019 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.859983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" event={"ID":"4adab9cf-0d88-4585-85f9-e607ce7ee85c","Type":"ContainerStarted","Data":"d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602"}
Jul 16 13:26:11.860234 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.860040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" event={"ID":"4adab9cf-0d88-4585-85f9-e607ce7ee85c","Type":"ContainerStarted","Data":"3be160e57a9ec89f610c78b7ae4054900228b702e35c74065c69fce4addfde07"}
Jul 16 13:26:11.885246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:11.885187    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podStartSLOduration=0.885166263 podStartE2EDuration="885.166263ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:26:11.883825887 +0000 UTC m=+2455.622815686" watchObservedRunningTime="2026-07-16 13:26:11.885166263 +0000 UTC m=+2455.624156045"
Jul 16 13:26:12.368431 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:12.368396    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:12.373454 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:12.373430    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:12.865559 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:12.865526    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:12.866665 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:12.866638    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:13.838138 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.834571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:13.858385 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.858354    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:13.929081 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.929039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:13.989196 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.989160    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"]
Jul 16 13:26:13.989771 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.989752    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy"
Jul 16 13:26:13.989843 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.989775    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e82e3d-fe0a-408f-aac1-59ae18ab58df" containerName="istio-proxy"
Jul 16 13:26:13.993368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.993346    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:13.995629 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:13.995609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c92f28-serving-cert\""
Jul 16 13:26:14.005661 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.005634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"]
Jul 16 13:26:14.035044 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.034929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:14.092828 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.092729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.093000 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.092827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc6kd\" (UniqueName: \"kubernetes.io/projected/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-kube-api-access-qc6kd\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.093000 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.092991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-openshift-service-ca\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.194390 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.194351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-openshift-service-ca\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.194591 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.194409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.194591 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.194460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc6kd\" (UniqueName: \"kubernetes.io/projected/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-kube-api-access-qc6kd\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.195038 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.195017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-openshift-service-ca\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.196876 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.196852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.203840 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.203818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc6kd\" (UniqueName: \"kubernetes.io/projected/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-kube-api-access-qc6kd\") pod \"maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.223064 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.223037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:14.306820 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.306787    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:14.503883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.503855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"]
Jul 16 13:26:14.505368 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:26:14.505342    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ae494c_8ba9_4311_a85c_675c3f0a2c6a.slice/crio-f94280cf83652e0ffefa67c06aa05650418d9c60b35c05a80875320ec5783968 WatchSource:0}: Error finding container f94280cf83652e0ffefa67c06aa05650418d9c60b35c05a80875320ec5783968: Status 404 returned error can't find the container with id f94280cf83652e0ffefa67c06aa05650418d9c60b35c05a80875320ec5783968
Jul 16 13:26:14.553979 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.553937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:14.655143 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.655023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:14.878768 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:14.878729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb" event={"ID":"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a","Type":"ContainerStarted","Data":"f94280cf83652e0ffefa67c06aa05650418d9c60b35c05a80875320ec5783968"}
Jul 16 13:26:15.891480 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:15.891436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb" event={"ID":"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a","Type":"ContainerStarted","Data":"96dcdc5d5ab9b59eff7ee5968a52096e3edc5b0b2909ee39ca83fcdc4299e2b8"}
Jul 16 13:26:15.891940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:15.891537    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:15.921186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:15.921131    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb" podStartSLOduration=2.486479533 podStartE2EDuration="2.921101426s" totalImagesPullingTime="434.621893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:26:15.918365367 +0000 UTC m=+2459.657355150" watchObservedRunningTime="2026-07-16 13:26:15.921101426 +0000 UTC m=+2459.660091206"
Jul 16 13:26:18.374687 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:18.374650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:20.190234 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.190200    2564 patch_prober.go:28] interesting pod/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:35282->10.134.0.65:15021: read: connection reset by peer" start-of-body=
Jul 16 13:26:20.190624 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.190265    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:35282->10.134.0.65:15021: read: connection reset by peer"
Jul 16 13:26:20.917503 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.917472    2564 generic.go:356] "Generic (PLEG): container finished" podID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerID="e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb" exitCode=0
Jul 16 13:26:20.917675 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.917551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" event={"ID":"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c","Type":"ContainerDied","Data":"e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb"}
Jul 16 13:26:20.917952 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.917936    2564 scope.go:117] "RemoveContainer" containerID="e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb"
Jul 16 13:26:20.918986 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.918958    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:20.919079 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.919041    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:20.919169 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:20.919090    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:21.902572 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:21.902542    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:26:21.966518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:21.966476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" event={"ID":"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c","Type":"ContainerStarted","Data":"949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61"}
Jul 16 13:26:22.787583 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:22.787541    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:22.787832 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:22.787807    2564 patch_prober.go:28] interesting pod/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 16 13:26:22.787878 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:22.787860    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 16 13:26:23.787946 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:23.787911    2564 patch_prober.go:28] interesting pod/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 16 13:26:23.788390 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:23.787976    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 16 13:26:24.787251 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:24.787213    2564 patch_prober.go:28] interesting pod/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 16 13:26:24.787435 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:24.787280    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 16 13:26:25.788008 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:25.787963    2564 patch_prober.go:28] interesting pod/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 16 13:26:25.788436 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:25.788037    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 16 13:26:26.790769 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:26.790737    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:26.791246 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:26.791064    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:26.791738 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:26.791721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:27.053993 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:27.053898    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:27.154404 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:27.154371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:28.867219 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:28.867178    2564 patch_prober.go:28] interesting pod/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 13:26:28.867618 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:28.867232    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 13:26:30.014590 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:30.014556    2564 generic.go:356] "Generic (PLEG): container finished" podID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerID="d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602" exitCode=0
Jul 16 13:26:30.015031 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:30.014627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" event={"ID":"4adab9cf-0d88-4585-85f9-e607ce7ee85c","Type":"ContainerDied","Data":"d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602"}
Jul 16 13:26:30.015031 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:30.015029    2564 scope.go:117] "RemoveContainer" containerID="d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602"
Jul 16 13:26:30.016087 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:30.016049    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:30.016219 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:30.016148    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:30.016219 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:30.016179    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:26:31.021693 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:31.021655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" event={"ID":"4adab9cf-0d88-4585-85f9-e607ce7ee85c","Type":"ContainerStarted","Data":"f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f"}
Jul 16 13:26:31.368032 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:31.367996    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:31.368266 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:31.368239    2564 patch_prober.go:28] interesting pod/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 16 13:26:31.368331 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:31.368305    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 16 13:26:32.368394 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:32.368357    2564 patch_prober.go:28] interesting pod/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 16 13:26:32.368789 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:32.368413    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 16 13:26:33.368742 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:33.368706    2564 patch_prober.go:28] interesting pod/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 16 13:26:33.369164 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:33.368780    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 16 13:26:34.368239 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:34.368199    2564 patch_prober.go:28] interesting pod/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 16 13:26:34.368495 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:34.368270    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 16 13:26:35.372202 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:35.372173    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:35.372624 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:35.372544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:35.373201 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:35.373181    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:26:35.580609 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:35.580572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:35.677569 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:35.677491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:37.047244 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.047206    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:37.147287 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.147255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:37.302899 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.302796    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"]
Jul 16 13:26:37.303367 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.303333    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx" podUID="d0030c71-90aa-47cc-85c0-9d433dc486e9" containerName="maas-api" containerID="cri-o://7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e" gracePeriod=30
Jul 16 13:26:37.328070 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.328030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:37.561417 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.561361    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:37.616414 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.616382    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0030c71-90aa-47cc-85c0-9d433dc486e9-openshift-service-ca\") pod \"d0030c71-90aa-47cc-85c0-9d433dc486e9\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") "
Jul 16 13:26:37.616575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.616456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpwrd\" (UniqueName: \"kubernetes.io/projected/d0030c71-90aa-47cc-85c0-9d433dc486e9-kube-api-access-cpwrd\") pod \"d0030c71-90aa-47cc-85c0-9d433dc486e9\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") "
Jul 16 13:26:37.616575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.616511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0030c71-90aa-47cc-85c0-9d433dc486e9-maas-api-tls\") pod \"d0030c71-90aa-47cc-85c0-9d433dc486e9\" (UID: \"d0030c71-90aa-47cc-85c0-9d433dc486e9\") "
Jul 16 13:26:37.616807 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.616779    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0030c71-90aa-47cc-85c0-9d433dc486e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d0030c71-90aa-47cc-85c0-9d433dc486e9" (UID: "d0030c71-90aa-47cc-85c0-9d433dc486e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:26:37.618477 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.618442    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0030c71-90aa-47cc-85c0-9d433dc486e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d0030c71-90aa-47cc-85c0-9d433dc486e9" (UID: "d0030c71-90aa-47cc-85c0-9d433dc486e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:26:37.618590 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.618519    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0030c71-90aa-47cc-85c0-9d433dc486e9-kube-api-access-cpwrd" (OuterVolumeSpecName: "kube-api-access-cpwrd") pod "d0030c71-90aa-47cc-85c0-9d433dc486e9" (UID: "d0030c71-90aa-47cc-85c0-9d433dc486e9"). InnerVolumeSpecName "kube-api-access-cpwrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:26:37.717656 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.717621    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0030c71-90aa-47cc-85c0-9d433dc486e9-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:37.717656 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.717651    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0030c71-90aa-47cc-85c0-9d433dc486e9-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:37.717656 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:37.717662    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpwrd\" (UniqueName: \"kubernetes.io/projected/d0030c71-90aa-47cc-85c0-9d433dc486e9-kube-api-access-cpwrd\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:38.069043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.069008    2564 generic.go:356] "Generic (PLEG): container finished" podID="d0030c71-90aa-47cc-85c0-9d433dc486e9" containerID="7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e" exitCode=0
Jul 16 13:26:38.069518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.069063    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"
Jul 16 13:26:38.069518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.069098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx" event={"ID":"d0030c71-90aa-47cc-85c0-9d433dc486e9","Type":"ContainerDied","Data":"7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e"}
Jul 16 13:26:38.069518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.069188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx" event={"ID":"d0030c71-90aa-47cc-85c0-9d433dc486e9","Type":"ContainerDied","Data":"b6c23acb03e21b503ffd2574e3fadfaa1f86a970db132892ba6b05a038b4459a"}
Jul 16 13:26:38.069518 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.069220    2564 scope.go:117] "RemoveContainer" containerID="7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e"
Jul 16 13:26:38.078707 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.078678    2564 scope.go:117] "RemoveContainer" containerID="7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e"
Jul 16 13:26:38.078950 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:26:38.078926    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e\": container with ID starting with 7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e not found: ID does not exist" containerID="7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e"
Jul 16 13:26:38.078993 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.078961    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e"} err="failed to get container status \"7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e\": rpc error: code = NotFound desc = could not find container \"7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e\": container with ID starting with 7a484c22d949bb1d453562c976a60f73d32ac0f71ac54167d1d2f83faf1f642e not found: ID does not exist"
Jul 16 13:26:38.091830 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.091804    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"]
Jul 16 13:26:38.098573 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.098550    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-62a003-5d6f9fb9b4-sgcbx"]
Jul 16 13:26:38.835368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:38.835332    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0030c71-90aa-47cc-85c0-9d433dc486e9" path="/var/lib/kubelet/pods/d0030c71-90aa-47cc-85c0-9d433dc486e9/volumes"
Jul 16 13:26:41.545080 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:41.545042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:48.164663 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:48.164627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:48.265780 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:48.265746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:52.272413 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:52.272378    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"]
Jul 16 13:26:52.272889 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:52.272593    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy" containerID="cri-o://949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61" gracePeriod=30
Jul 16 13:26:52.310898 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:52.310870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:52.486374 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:52.486338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:53.268719 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:53.268684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:53.370168 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:53.370141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:26:56.793677 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:56.793631    2564 patch_prober.go:28] interesting pod/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 13:26:56.794048 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:56.793709    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 13:26:57.535049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.534990    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:57.704585 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-envoy\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.704585 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704590    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-socket\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.704837 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704614    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq74m\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-kube-api-access-vq74m\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.704837 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704666    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-credential-socket\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.704837 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704709    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-certs\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.704837 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704746    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-podinfo\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.704837 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704780    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-data\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.705097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704859    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istiod-ca-cert\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.705097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704864    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:57.705097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704892    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-token\") pod \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\" (UID: \"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c\") "
Jul 16 13:26:57.705097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.704967    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:57.705097 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.705072    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:57.705421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.705261    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.705421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.705284    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.705421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.705299    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.705592 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.705511    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:26:57.705894 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.705865    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:57.706950 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.706917    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:26:57.707077 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.706985    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-kube-api-access-vq74m" (OuterVolumeSpecName: "kube-api-access-vq74m") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "kube-api-access-vq74m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:26:57.707077 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.707007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:26:57.707077 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.707014    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" (UID: "c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:26:57.806090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.805991    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.806090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.806032    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.806090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.806042    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.806090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.806052    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq74m\" (UniqueName: \"kubernetes.io/projected/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-kube-api-access-vq74m\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.806090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.806061    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:57.806090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:57.806069    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:26:58.179508 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.179475    2564 generic.go:356] "Generic (PLEG): container finished" podID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerID="949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61" exitCode=0
Jul 16 13:26:58.179706 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.179526    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"
Jul 16 13:26:58.179706 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.179560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" event={"ID":"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c","Type":"ContainerDied","Data":"949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61"}
Jul 16 13:26:58.179706 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.179617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk" event={"ID":"c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c","Type":"ContainerDied","Data":"40fd3e8772d495472693515655e40752f287de2188c9a1e3a55f0eaace28be3d"}
Jul 16 13:26:58.179706 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.179643    2564 scope.go:117] "RemoveContainer" containerID="949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61"
Jul 16 13:26:58.188940 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.188923    2564 scope.go:117] "RemoveContainer" containerID="e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb"
Jul 16 13:26:58.196877 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.196855    2564 scope.go:117] "RemoveContainer" containerID="949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61"
Jul 16 13:26:58.197178 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:26:58.197154    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61\": container with ID starting with 949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61 not found: ID does not exist" containerID="949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61"
Jul 16 13:26:58.197244 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.197193    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61"} err="failed to get container status \"949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61\": rpc error: code = NotFound desc = could not find container \"949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61\": container with ID starting with 949e5c814ef75492480c6867a5de1cb2af7f7731aeb69c0c2abad38a0eff0b61 not found: ID does not exist"
Jul 16 13:26:58.197244 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.197216    2564 scope.go:117] "RemoveContainer" containerID="e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb"
Jul 16 13:26:58.197431 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:26:58.197416    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb\": container with ID starting with e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb not found: ID does not exist" containerID="e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb"
Jul 16 13:26:58.197475 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.197435    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb"} err="failed to get container status \"e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb\": rpc error: code = NotFound desc = could not find container \"e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb\": container with ID starting with e10d8fe1e0c1cfe754546ade7b26aca1e33922095e89db28c54f067308b7ffdb not found: ID does not exist"
Jul 16 13:26:58.204924 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.204902    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"]
Jul 16 13:26:58.208705 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.208684    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-62a003-openshift-default-f99cdb9f5-4t8mk"]
Jul 16 13:26:58.834440 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:26:58.834405    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" path="/var/lib/kubelet/pods/c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c/volumes"
Jul 16 13:27:03.064552 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.064512    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"]
Jul 16 13:27:03.064993 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.064753    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb" podUID="f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" containerName="maas-api" containerID="cri-o://96dcdc5d5ab9b59eff7ee5968a52096e3edc5b0b2909ee39ca83fcdc4299e2b8" gracePeriod=30
Jul 16 13:27:03.095332 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.095299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:03.215902 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.215867    2564 generic.go:356] "Generic (PLEG): container finished" podID="f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" containerID="96dcdc5d5ab9b59eff7ee5968a52096e3edc5b0b2909ee39ca83fcdc4299e2b8" exitCode=0
Jul 16 13:27:03.216134 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.216011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb" event={"ID":"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a","Type":"ContainerDied","Data":"96dcdc5d5ab9b59eff7ee5968a52096e3edc5b0b2909ee39ca83fcdc4299e2b8"}
Jul 16 13:27:03.321987 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.321926    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:27:03.454400 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.454365    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-openshift-service-ca\") pod \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") "
Jul 16 13:27:03.454578 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.454443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-maas-api-tls\") pod \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") "
Jul 16 13:27:03.454578 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.454519    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc6kd\" (UniqueName: \"kubernetes.io/projected/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-kube-api-access-qc6kd\") pod \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\" (UID: \"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a\") "
Jul 16 13:27:03.454826 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.454801    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" (UID: "f2ae494c-8ba9-4311-a85c-675c3f0a2c6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:27:03.456556 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.456527    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-kube-api-access-qc6kd" (OuterVolumeSpecName: "kube-api-access-qc6kd") pod "f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" (UID: "f2ae494c-8ba9-4311-a85c-675c3f0a2c6a"). InnerVolumeSpecName "kube-api-access-qc6kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:27:03.456654 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.456573    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" (UID: "f2ae494c-8ba9-4311-a85c-675c3f0a2c6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:27:03.555796 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.555759    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc6kd\" (UniqueName: \"kubernetes.io/projected/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-kube-api-access-qc6kd\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:03.555796 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.555789    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:03.555796 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:03.555800    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:04.222142 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:04.222088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb" event={"ID":"f2ae494c-8ba9-4311-a85c-675c3f0a2c6a","Type":"ContainerDied","Data":"f94280cf83652e0ffefa67c06aa05650418d9c60b35c05a80875320ec5783968"}
Jul 16 13:27:04.222142 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:04.222136    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"
Jul 16 13:27:04.222660 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:04.222184    2564 scope.go:117] "RemoveContainer" containerID="96dcdc5d5ab9b59eff7ee5968a52096e3edc5b0b2909ee39ca83fcdc4299e2b8"
Jul 16 13:27:04.246037 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:04.246008    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"]
Jul 16 13:27:04.250006 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:04.249983    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c92f28-7d5796985c-vfrhb"]
Jul 16 13:27:04.834636 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:04.834604    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" path="/var/lib/kubelet/pods/f2ae494c-8ba9-4311-a85c-675c3f0a2c6a/volumes"
Jul 16 13:27:07.700015 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:07.699971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:14.036752 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:14.036664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:14.096484 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:14.096454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:18.378063 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:18.378029    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"]
Jul 16 13:27:18.378502 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:18.378254    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy" containerID="cri-o://f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f" gracePeriod=30
Jul 16 13:27:18.401238 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:18.401095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:18.611883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:18.611847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:18.961704 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:18.961669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:19.254279 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.254186    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"]
Jul 16 13:27:19.254735 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.254711    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0030c71-90aa-47cc-85c0-9d433dc486e9" containerName="maas-api"
Jul 16 13:27:19.254900 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.254885    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0030c71-90aa-47cc-85c0-9d433dc486e9" containerName="maas-api"
Jul 16 13:27:19.255024 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255004    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy"
Jul 16 13:27:19.255024 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255025    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy"
Jul 16 13:27:19.255186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255039    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" containerName="maas-api"
Jul 16 13:27:19.255186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" containerName="maas-api"
Jul 16 13:27:19.255186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255174    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy"
Jul 16 13:27:19.255186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255183    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy"
Jul 16 13:27:19.255317 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255190    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0030c71-90aa-47cc-85c0-9d433dc486e9" containerName="maas-api"
Jul 16 13:27:19.255317 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.255196    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ae494c-8ba9-4311-a85c-675c3f0a2c6a" containerName="maas-api"
Jul 16 13:27:19.259707 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.259688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.262423 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.262406    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-978d92-openshift-default-dockercfg-bv77s\""
Jul 16 13:27:19.270213 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.270182    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"]
Jul 16 13:27:19.288101 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.288075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:19.302824 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.302793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-credential-socket\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.302971 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.302838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-socket\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.302971 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.302856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/045c2707-99c2-40bc-81a2-62e5bd7ff156-istiod-ca-cert\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.302971 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.302941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhgc9\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-kube-api-access-jhgc9\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.303153 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.302991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-envoy\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.303153 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.303030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-data\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.303153 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.303054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-token\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.303298 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.303147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-certs\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.303298 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.303198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-podinfo\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404058 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-credential-socket\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-socket\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/045c2707-99c2-40bc-81a2-62e5bd7ff156-istiod-ca-cert\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhgc9\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-kube-api-access-jhgc9\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-envoy\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-data\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-token\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-certs\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-credential-socket\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.404517 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-podinfo\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.405018 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404670    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-data\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.405018 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-certs\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.405018 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-socket\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.405018 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.404949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/045c2707-99c2-40bc-81a2-62e5bd7ff156-istiod-ca-cert\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.406691 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.406669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-envoy\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.407016 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.406995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-podinfo\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.413811 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.413788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-token\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.413988 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.413932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhgc9\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-kube-api-access-jhgc9\") pod \"e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") " pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.562605 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.562527    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:19.570765 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.570747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:19.717834 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.717805    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"]
Jul 16 13:27:19.719012 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:27:19.718984    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045c2707_99c2_40bc_81a2_62e5bd7ff156.slice/crio-97c5f8cc402ab03fdcb5406122e0e033bd9e269a6beac706bd42e3c67b417201 WatchSource:0}: Error finding container 97c5f8cc402ab03fdcb5406122e0e033bd9e269a6beac706bd42e3c67b417201: Status 404 returned error can't find the container with id 97c5f8cc402ab03fdcb5406122e0e033bd9e269a6beac706bd42e3c67b417201
Jul 16 13:27:19.721211 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.721182    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:27:19.721310 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.721244    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:27:19.721310 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:19.721273    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:27:20.305237 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:20.305200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" event={"ID":"045c2707-99c2-40bc-81a2-62e5bd7ff156","Type":"ContainerStarted","Data":"b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3"}
Jul 16 13:27:20.305416 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:20.305267    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" event={"ID":"045c2707-99c2-40bc-81a2-62e5bd7ff156","Type":"ContainerStarted","Data":"97c5f8cc402ab03fdcb5406122e0e033bd9e269a6beac706bd42e3c67b417201"}
Jul 16 13:27:20.328979 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:20.328921    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" podStartSLOduration=1.328900003 podStartE2EDuration="1.328900003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:27:20.32476314 +0000 UTC m=+2524.063752934" watchObservedRunningTime="2026-07-16 13:27:20.328900003 +0000 UTC m=+2524.067889785"
Jul 16 13:27:20.374959 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:20.374931    2564 patch_prober.go:28] interesting pod/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 13:27:20.375144 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:20.374981    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 13:27:20.571096 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:20.571019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:20.575997 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:20.575973    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:21.310407 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:21.310378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:21.311255 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:21.311236    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:22.255278 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.255245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:22.357091 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.357057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:22.501371 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.501334    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"]
Jul 16 13:27:22.501792 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.501774    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy"
Jul 16 13:27:22.501884 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.501795    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c135cdfd-7841-48d8-b2f1-cbb3d9ca3f9c" containerName="istio-proxy"
Jul 16 13:27:22.504995 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.504973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.507336 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.507274    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-978d92-serving-cert\""
Jul 16 13:27:22.515415 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.515388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"]
Jul 16 13:27:22.533255 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.533229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:22.632151 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.632086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm4v6\" (UniqueName: \"kubernetes.io/projected/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-kube-api-access-cm4v6\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.632353 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.632174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.632353 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.632234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.733672 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.733640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm4v6\" (UniqueName: \"kubernetes.io/projected/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-kube-api-access-cm4v6\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.733672 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.733681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.733918 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.733714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.733918 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:27:22.733806    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-serving-cert: secret "maas-api-e2e-shared-a-978d92-serving-cert" not found
Jul 16 13:27:22.733918 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:27:22.733868    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls podName:ad67df23-5a4a-475f-9e82-e5eb56a8a08b nodeName:}" failed. No retries permitted until 2026-07-16 13:27:23.233852575 +0000 UTC m=+2526.972842335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls") pod "maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9" (UID: "ad67df23-5a4a-475f-9e82-e5eb56a8a08b") : secret "maas-api-e2e-shared-a-978d92-serving-cert" not found
Jul 16 13:27:22.734347 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.734330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.742689 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.742655    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm4v6\" (UniqueName: \"kubernetes.io/projected/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-kube-api-access-cm4v6\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:22.876167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:22.876134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:23.022889 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.022858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:23.120468 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.120435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:23.236996 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.236910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:23.239259 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.239231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls\") pod \"maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:23.418207 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.418167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:23.567695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.567417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"]
Jul 16 13:27:23.570205 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:27:23.570176    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad67df23_5a4a_475f_9e82_e5eb56a8a08b.slice/crio-be8510b25af1841c7961487aea7dae6d05bf7c53065f1c281bcf9c62bcff2981 WatchSource:0}: Error finding container be8510b25af1841c7961487aea7dae6d05bf7c53065f1c281bcf9c62bcff2981: Status 404 returned error can't find the container with id be8510b25af1841c7961487aea7dae6d05bf7c53065f1c281bcf9c62bcff2981
Jul 16 13:27:23.646223 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.646195    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:27:23.741702 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741666    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-certs\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.741702 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741705    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istiod-ca-cert\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.741936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741770    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-podinfo\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.741936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741796    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-envoy\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.741936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741849    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bknm5\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-kube-api-access-bknm5\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.741936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741872    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-credential-socket\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.741936 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-token\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.742245 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741937    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-socket\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.742245 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.741966    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-data\") pod \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\" (UID: \"4adab9cf-0d88-4585-85f9-e607ce7ee85c\") "
Jul 16 13:27:23.742245 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.742021    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:27:23.742413 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.742318    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.742482 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.742420    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:27:23.742548 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.742501    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:27:23.743531 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.743499    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-data" (OuterVolumeSpecName: "istio-data") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:27:23.744421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.744202    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:27:23.744421 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.744401    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:27:23.744588 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.744419    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-kube-api-access-bknm5" (OuterVolumeSpecName: "kube-api-access-bknm5") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "kube-api-access-bknm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:27:23.744588 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.744467    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:27:23.744588 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.744527    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4adab9cf-0d88-4585-85f9-e607ce7ee85c" (UID: "4adab9cf-0d88-4585-85f9-e607ce7ee85c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844063    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844121    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844138    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bknm5\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-kube-api-access-bknm5\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844154    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844169    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844187    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844200    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:23.849150 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:23.844214    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adab9cf-0d88-4585-85f9-e607ce7ee85c-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:27:24.326506 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.326409    2564 generic.go:356] "Generic (PLEG): container finished" podID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerID="f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f" exitCode=0
Jul 16 13:27:24.326506 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.326481    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"
Jul 16 13:27:24.326506 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.326488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" event={"ID":"4adab9cf-0d88-4585-85f9-e607ce7ee85c","Type":"ContainerDied","Data":"f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f"}
Jul 16 13:27:24.326927 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.326582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q" event={"ID":"4adab9cf-0d88-4585-85f9-e607ce7ee85c","Type":"ContainerDied","Data":"3be160e57a9ec89f610c78b7ae4054900228b702e35c74065c69fce4addfde07"}
Jul 16 13:27:24.326927 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.326613    2564 scope.go:117] "RemoveContainer" containerID="f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f"
Jul 16 13:27:24.328479 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.328453    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9" event={"ID":"ad67df23-5a4a-475f-9e82-e5eb56a8a08b","Type":"ContainerStarted","Data":"9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3"}
Jul 16 13:27:24.328593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.328504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9" event={"ID":"ad67df23-5a4a-475f-9e82-e5eb56a8a08b","Type":"ContainerStarted","Data":"be8510b25af1841c7961487aea7dae6d05bf7c53065f1c281bcf9c62bcff2981"}
Jul 16 13:27:24.328593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.328553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:24.337020 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.336998    2564 scope.go:117] "RemoveContainer" containerID="d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602"
Jul 16 13:27:24.345010 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.344989    2564 scope.go:117] "RemoveContainer" containerID="f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f"
Jul 16 13:27:24.345302 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:27:24.345281    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f\": container with ID starting with f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f not found: ID does not exist" containerID="f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f"
Jul 16 13:27:24.345371 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.345311    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f"} err="failed to get container status \"f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f\": rpc error: code = NotFound desc = could not find container \"f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f\": container with ID starting with f321a2cc0e6ccdecf54350148b22a38912032fd05c7b293df5ea8b16fbeda67f not found: ID does not exist"
Jul 16 13:27:24.345371 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.345336    2564 scope.go:117] "RemoveContainer" containerID="d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602"
Jul 16 13:27:24.345588 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:27:24.345570    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602\": container with ID starting with d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602 not found: ID does not exist" containerID="d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602"
Jul 16 13:27:24.345655 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.345594    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602"} err="failed to get container status \"d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602\": rpc error: code = NotFound desc = could not find container \"d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602\": container with ID starting with d07ed7fde668c0a0932c04b63a3892b19f6e126667ffecf415156626566cd602 not found: ID does not exist"
Jul 16 13:27:24.349710 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.349666    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9" podStartSLOduration=1.973098733 podStartE2EDuration="2.349651539s" totalImagesPullingTime="376.552806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:27:24.347188597 +0000 UTC m=+2528.086178390" watchObservedRunningTime="2026-07-16 13:27:24.349651539 +0000 UTC m=+2528.088641318"
Jul 16 13:27:24.362663 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.362637    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"]
Jul 16 13:27:24.369199 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.369170    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c92f28-openshift-default-68999f67b5-d8t4q"]
Jul 16 13:27:24.714703 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.714669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:24.836365 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:24.836329    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" path="/var/lib/kubelet/pods/4adab9cf-0d88-4585-85f9-e607ce7ee85c/volumes"
Jul 16 13:27:26.741415 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:26.741377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:27.081997 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:27.081909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:27.415359 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:27.415328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:27.699560 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:27.699483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:30.347328 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.347285    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:27:30.532132 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.531709    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"]
Jul 16 13:27:30.539131 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.532353    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy"
Jul 16 13:27:30.539131 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.532377    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy"
Jul 16 13:27:30.539131 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.532499    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy"
Jul 16 13:27:30.539131 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.538507    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.546132 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.542782    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-c7dd05-serving-cert\""
Jul 16 13:27:30.567547 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.567519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"]
Jul 16 13:27:30.613883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.613798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.613883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.613833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs6h9\" (UniqueName: \"kubernetes.io/projected/f29be06d-55b9-4a87-a8d1-8675db0397d9-kube-api-access-hs6h9\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.614064 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.613920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29be06d-55b9-4a87-a8d1-8675db0397d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.714724 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.714680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29be06d-55b9-4a87-a8d1-8675db0397d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.714901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.714799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.714901 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.714820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6h9\" (UniqueName: \"kubernetes.io/projected/f29be06d-55b9-4a87-a8d1-8675db0397d9-kube-api-access-hs6h9\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.714981 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:27:30.714942    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-serving-cert: secret "maas-api-e2e-shared-b-c7dd05-serving-cert" not found
Jul 16 13:27:30.715032 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:27:30.715018    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls podName:f29be06d-55b9-4a87-a8d1-8675db0397d9 nodeName:}" failed. No retries permitted until 2026-07-16 13:27:31.214998274 +0000 UTC m=+2534.953988045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls") pod "maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm" (UID: "f29be06d-55b9-4a87-a8d1-8675db0397d9") : secret "maas-api-e2e-shared-b-c7dd05-serving-cert" not found
Jul 16 13:27:30.715409 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.715389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29be06d-55b9-4a87-a8d1-8675db0397d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.732125 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.732072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs6h9\" (UniqueName: \"kubernetes.io/projected/f29be06d-55b9-4a87-a8d1-8675db0397d9-kube-api-access-hs6h9\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:30.780409 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.780372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:30.880173 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.880065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:30.980413 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:30.980383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:31.164666 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:31.164578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:31.219579 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:31.219547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:31.221935 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:31.221910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:31.264212 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:31.264178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:31.478717 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:31.478617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:31.674992 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:31.674955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"]
Jul 16 13:27:31.678310 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:27:31.678281    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29be06d_55b9_4a87_a8d1_8675db0397d9.slice/crio-01f5a2991cb15759007667424681cc5b0fed904d7e9446bfa1873170ebd66771 WatchSource:0}: Error finding container 01f5a2991cb15759007667424681cc5b0fed904d7e9446bfa1873170ebd66771: Status 404 returned error can't find the container with id 01f5a2991cb15759007667424681cc5b0fed904d7e9446bfa1873170ebd66771
Jul 16 13:27:32.374137 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:32.374090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm" event={"ID":"f29be06d-55b9-4a87-a8d1-8675db0397d9","Type":"ContainerStarted","Data":"01f5a2991cb15759007667424681cc5b0fed904d7e9446bfa1873170ebd66771"}
Jul 16 13:27:33.381494 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:33.381406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm" event={"ID":"f29be06d-55b9-4a87-a8d1-8675db0397d9","Type":"ContainerStarted","Data":"c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195"}
Jul 16 13:27:33.381494 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:33.381468    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:33.410880 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:33.410826    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm" podStartSLOduration=2.478932413 podStartE2EDuration="3.410808559s" totalImagesPullingTime="931.876146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:27:33.40969156 +0000 UTC m=+2537.148681350" watchObservedRunningTime="2026-07-16 13:27:33.410808559 +0000 UTC m=+2537.149798338"
Jul 16 13:27:34.749234 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:34.749198    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:36.311769 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.311671    2564 patch_prober.go:28] interesting pod/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 16 13:27:36.311769 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.311741    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 16 13:27:36.398983 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.398950    2564 generic.go:356] "Generic (PLEG): container finished" podID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerID="b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3" exitCode=0
Jul 16 13:27:36.399175 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.399024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" event={"ID":"045c2707-99c2-40bc-81a2-62e5bd7ff156","Type":"ContainerDied","Data":"b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3"}
Jul 16 13:27:36.399526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.399508    2564 scope.go:117] "RemoveContainer" containerID="b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3"
Jul 16 13:27:36.400528 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.400497    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:27:36.400621 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.400582    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:27:36.400684 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:36.400631    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 13:27:37.406558 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:37.406522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" event={"ID":"045c2707-99c2-40bc-81a2-62e5bd7ff156","Type":"ContainerStarted","Data":"aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6"}
Jul 16 13:27:37.571285 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:37.571248    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:37.571545 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:37.571520    2564 patch_prober.go:28] interesting pod/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 16 13:27:37.571593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:37.571578    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 16 13:27:38.571886 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:38.571854    2564 patch_prober.go:28] interesting pod/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 16 13:27:38.572349 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:38.571907    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 16 13:27:39.393750 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:39.393719    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:27:39.571937 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:39.571902    2564 patch_prober.go:28] interesting pod/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 16 13:27:39.572381 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:39.571969    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 16 13:27:40.571920 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:40.571769    2564 patch_prober.go:28] interesting pod/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 16 13:27:40.571920 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:40.571822    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 16 13:27:41.575915 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:41.575876    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:41.576422 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:41.576148    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:41.577065 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:41.577049    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:27:43.974294 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:43.974265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:44.074292 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:44.074261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:45.719059 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:45.719027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:52.104794 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:52.104755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:27:52.203449 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:27:52.203364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:28:11.737533 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:28:11.737493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:28:27.223932 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:28:27.223895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:28:27.324734 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:28:27.324698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:29:38.091682 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:29:38.091645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:29:39.371819 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:29:39.371784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:30:00.142235 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.142194    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn"]
Jul 16 13:30:00.142618 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.142582    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy"
Jul 16 13:30:00.142618 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.142592    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy"
Jul 16 13:30:00.142738 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.142670    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4adab9cf-0d88-4585-85f9-e607ce7ee85c" containerName="istio-proxy"
Jul 16 13:30:00.145702 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.145681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn"
Jul 16 13:30:00.146575 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.146553    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"]
Jul 16 13:30:00.149661 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.149639    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:30:00.151162 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.151143    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"]
Jul 16 13:30:00.151284 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.151253    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"
Jul 16 13:30:00.154534 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.154518    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"
Jul 16 13:30:00.157021 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.157005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn"
Jul 16 13:30:00.164716 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.164698    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"
Jul 16 13:30:00.169340 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.169318    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn"]
Jul 16 13:30:00.173378 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.173306    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"]
Jul 16 13:30:00.176883 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.176851    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"]
Jul 16 13:30:00.207891 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.207858    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"
Jul 16 13:30:00.334302 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.333607    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn"]
Jul 16 13:30:00.363199 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.363171    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"]
Jul 16 13:30:00.365416 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:30:00.365389    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c26431_10a7_4236_8d97_90314e9a522b.slice/crio-d562a5b1578b313f64f974edfa389012430e38af05b20f99ee73272910807035 WatchSource:0}: Error finding container d562a5b1578b313f64f974edfa389012430e38af05b20f99ee73272910807035: Status 404 returned error can't find the container with id d562a5b1578b313f64f974edfa389012430e38af05b20f99ee73272910807035
Jul 16 13:30:00.391361 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:00.391335    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"]
Jul 16 13:30:01.158046 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.158009    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76" event={"ID":"a92b63ed-ff04-4d57-8bb7-26443cb85d46","Type":"ContainerStarted","Data":"cff2db95c23a168e418cb548fd73ae0ca53f83e9d8463af72fd28b5ca0f2c050"}
Jul 16 13:30:01.158547 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.158070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76" event={"ID":"a92b63ed-ff04-4d57-8bb7-26443cb85d46","Type":"ContainerStarted","Data":"79e299f1db9368d3ca39d969897f4d944e19365e75d84334e897a355b46fb107"}
Jul 16 13:30:01.165971 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.165935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8" event={"ID":"a9c26431-10a7-4236-8d97-90314e9a522b","Type":"ContainerStarted","Data":"552f793968a7b0fdb2d33ee1a97273477f4c60402c902544d1510051b200acfc"}
Jul 16 13:30:01.166172 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.166023    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8" event={"ID":"a9c26431-10a7-4236-8d97-90314e9a522b","Type":"ContainerStarted","Data":"d562a5b1578b313f64f974edfa389012430e38af05b20f99ee73272910807035"}
Jul 16 13:30:01.167585 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.167560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn" event={"ID":"db099e06-afd7-4409-b08a-b8f48bfc8500","Type":"ContainerStarted","Data":"79852b2a9f1c4ab23967263f31c8e52d007a03a5218ebf81aa316fe1d00e420d"}
Jul 16 13:30:01.167717 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.167603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn" event={"ID":"db099e06-afd7-4409-b08a-b8f48bfc8500","Type":"ContainerStarted","Data":"103db5f14912cd7b33400c5ce5dba93175905c8b40b1ab798d18a85084902ef1"}
Jul 16 13:30:01.180678 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.180633    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76" podStartSLOduration=1.180620927 podStartE2EDuration="1.180620927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:30:01.177636004 +0000 UTC m=+2684.916625782" watchObservedRunningTime="2026-07-16 13:30:01.180620927 +0000 UTC m=+2684.919610705"
Jul 16 13:30:01.195677 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.195631    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn" podStartSLOduration=1.195617325 podStartE2EDuration="1.195617325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:30:01.194551549 +0000 UTC m=+2684.933541327" watchObservedRunningTime="2026-07-16 13:30:01.195617325 +0000 UTC m=+2684.934607103"
Jul 16 13:30:01.212323 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:01.212277    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8" podStartSLOduration=1.212262612 podStartE2EDuration="1.212262612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:30:01.211372536 +0000 UTC m=+2684.950362325" watchObservedRunningTime="2026-07-16 13:30:01.212262612 +0000 UTC m=+2684.951252391"
Jul 16 13:30:02.174891 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:02.174857    2564 generic.go:356] "Generic (PLEG): container finished" podID="a9c26431-10a7-4236-8d97-90314e9a522b" containerID="552f793968a7b0fdb2d33ee1a97273477f4c60402c902544d1510051b200acfc" exitCode=0
Jul 16 13:30:02.175332 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:02.174950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8" event={"ID":"a9c26431-10a7-4236-8d97-90314e9a522b","Type":"ContainerDied","Data":"552f793968a7b0fdb2d33ee1a97273477f4c60402c902544d1510051b200acfc"}
Jul 16 13:30:02.176439 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:02.176416    2564 generic.go:356] "Generic (PLEG): container finished" podID="db099e06-afd7-4409-b08a-b8f48bfc8500" containerID="79852b2a9f1c4ab23967263f31c8e52d007a03a5218ebf81aa316fe1d00e420d" exitCode=0
Jul 16 13:30:02.176573 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:02.176504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn" event={"ID":"db099e06-afd7-4409-b08a-b8f48bfc8500","Type":"ContainerDied","Data":"79852b2a9f1c4ab23967263f31c8e52d007a03a5218ebf81aa316fe1d00e420d"}
Jul 16 13:30:02.177892 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:02.177872    2564 generic.go:356] "Generic (PLEG): container finished" podID="a92b63ed-ff04-4d57-8bb7-26443cb85d46" containerID="cff2db95c23a168e418cb548fd73ae0ca53f83e9d8463af72fd28b5ca0f2c050" exitCode=0
Jul 16 13:30:02.177984 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:02.177942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76" event={"ID":"a92b63ed-ff04-4d57-8bb7-26443cb85d46","Type":"ContainerDied","Data":"cff2db95c23a168e418cb548fd73ae0ca53f83e9d8463af72fd28b5ca0f2c050"}
Jul 16 13:30:03.334217 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:03.334184    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"
Jul 16 13:30:03.399661 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:03.399634    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"
Jul 16 13:30:03.402542 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:03.402492    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn"
Jul 16 13:30:04.190046 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.190020    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"
Jul 16 13:30:04.190255 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.190067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76" event={"ID":"a92b63ed-ff04-4d57-8bb7-26443cb85d46","Type":"ContainerDied","Data":"79e299f1db9368d3ca39d969897f4d944e19365e75d84334e897a355b46fb107"}
Jul 16 13:30:04.190255 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.190147    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79e299f1db9368d3ca39d969897f4d944e19365e75d84334e897a355b46fb107"
Jul 16 13:30:04.191281 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.191264    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"
Jul 16 13:30:04.191433 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.191306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8" event={"ID":"a9c26431-10a7-4236-8d97-90314e9a522b","Type":"ContainerDied","Data":"d562a5b1578b313f64f974edfa389012430e38af05b20f99ee73272910807035"}
Jul 16 13:30:04.191433 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.191359    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d562a5b1578b313f64f974edfa389012430e38af05b20f99ee73272910807035"
Jul 16 13:30:04.192600 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.192579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn" event={"ID":"db099e06-afd7-4409-b08a-b8f48bfc8500","Type":"ContainerDied","Data":"103db5f14912cd7b33400c5ce5dba93175905c8b40b1ab798d18a85084902ef1"}
Jul 16 13:30:04.192600 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.192591    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736810-666fn"
Jul 16 13:30:04.192743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:04.192617    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="103db5f14912cd7b33400c5ce5dba93175905c8b40b1ab798d18a85084902ef1"
Jul 16 13:30:21.410746 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:21.410656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:30:22.390566 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:22.390527    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:30:30.110919 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:30.110884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:30:46.051039 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:46.051008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:30:46.517689 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:30:46.517655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:31:22.188489 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:31:22.188451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:31:22.288014 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:31:22.287982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:31:35.007122 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:31:35.007085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:31:35.978593 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:31:35.978556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:31:44.425583 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:31:44.425547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:32:18.539516 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:32:18.539468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:32:44.972642 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:32:44.972599    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:32:45.078772 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:32:45.078719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:32:53.037438 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:32:53.037403    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:32:53.137764 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:32:53.137731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:13.323294 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:13.323193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:14.220231 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:14.220190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:32.390912 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:32.390876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:33.354179 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354145    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"]
Jul 16 13:33:33.354558 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354546    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92b63ed-ff04-4d57-8bb7-26443cb85d46" containerName="cleanup"
Jul 16 13:33:33.354604 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354559    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92b63ed-ff04-4d57-8bb7-26443cb85d46" containerName="cleanup"
Jul 16 13:33:33.354604 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354574    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db099e06-afd7-4409-b08a-b8f48bfc8500" containerName="cleanup"
Jul 16 13:33:33.354604 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354580    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db099e06-afd7-4409-b08a-b8f48bfc8500" containerName="cleanup"
Jul 16 13:33:33.354604 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354594    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c26431-10a7-4236-8d97-90314e9a522b" containerName="cleanup"
Jul 16 13:33:33.354604 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354602    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c26431-10a7-4236-8d97-90314e9a522b" containerName="cleanup"
Jul 16 13:33:33.354760 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354655    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c26431-10a7-4236-8d97-90314e9a522b" containerName="cleanup"
Jul 16 13:33:33.354760 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354665    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a92b63ed-ff04-4d57-8bb7-26443cb85d46" containerName="cleanup"
Jul 16 13:33:33.354760 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.354674    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db099e06-afd7-4409-b08a-b8f48bfc8500" containerName="cleanup"
Jul 16 13:33:33.357830 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.357813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"
Jul 16 13:33:33.360894 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.360876    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:33:33.367810 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.367785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"]
Jul 16 13:33:33.413712 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.413668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t\" (UID: \"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"
Jul 16 13:33:33.515170 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.515130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t\" (UID: \"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"
Jul 16 13:33:33.515729 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.515708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t\" (UID: \"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"
Jul 16 13:33:33.668880 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.668783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"
Jul 16 13:33:33.815398 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:33.815373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"]
Jul 16 13:33:33.816788 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:33:33.816755    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffedb6f3_f1b1_4e6a_80f3_9a8d0a3b11a3.slice/crio-37782d9ff2db05b82a015c2c67cb3c5b14a60df52abf949647bd00c2cb6a2b22 WatchSource:0}: Error finding container 37782d9ff2db05b82a015c2c67cb3c5b14a60df52abf949647bd00c2cb6a2b22: Status 404 returned error can't find the container with id 37782d9ff2db05b82a015c2c67cb3c5b14a60df52abf949647bd00c2cb6a2b22
Jul 16 13:33:34.253373 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:34.253286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:34.321528 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:34.321489    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t" event={"ID":"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3","Type":"ContainerStarted","Data":"5fd86cb175d6ddc0cee25c2dff04be1b4ae8c81ff4ae47943bfc1bf87b306218"}
Jul 16 13:33:34.321725 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:34.321548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t" event={"ID":"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3","Type":"ContainerStarted","Data":"37782d9ff2db05b82a015c2c67cb3c5b14a60df52abf949647bd00c2cb6a2b22"}
Jul 16 13:33:34.339191 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:34.339138    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t" podStartSLOduration=1.339103542 podStartE2EDuration="1.339103542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:33:34.337480644 +0000 UTC m=+2898.076470446" watchObservedRunningTime="2026-07-16 13:33:34.339103542 +0000 UTC m=+2898.078093337"
Jul 16 13:33:34.343245 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:34.343202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:35.334756 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:35.334720    2564 generic.go:356] "Generic (PLEG): container finished" podID="ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3" containerID="5fd86cb175d6ddc0cee25c2dff04be1b4ae8c81ff4ae47943bfc1bf87b306218" exitCode=0
Jul 16 13:33:35.335259 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:35.334806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t" event={"ID":"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3","Type":"ContainerDied","Data":"5fd86cb175d6ddc0cee25c2dff04be1b4ae8c81ff4ae47943bfc1bf87b306218"}
Jul 16 13:33:36.479039 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:36.479015    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"
Jul 16 13:33:36.542890 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:36.542860    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3-maas-api-service-ca\") pod \"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3\" (UID: \"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3\") "
Jul 16 13:33:36.543232 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:36.543209    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3" (UID: "ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:33:36.643510 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:36.643417    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:33:37.347423 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:37.347395    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t"
Jul 16 13:33:37.347423 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:37.347419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t" event={"ID":"ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3","Type":"ContainerDied","Data":"37782d9ff2db05b82a015c2c67cb3c5b14a60df52abf949647bd00c2cb6a2b22"}
Jul 16 13:33:37.347645 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:37.347469    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37782d9ff2db05b82a015c2c67cb3c5b14a60df52abf949647bd00c2cb6a2b22"
Jul 16 13:33:43.917606 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:43.917566    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"]
Jul 16 13:33:43.918076 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:43.917870    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9" podUID="ad67df23-5a4a-475f-9e82-e5eb56a8a08b" containerName="maas-api" containerID="cri-o://9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3" gracePeriod=30
Jul 16 13:33:43.954989 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:43.954956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:43.964414 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:43.964389    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"]
Jul 16 13:33:43.969366 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:43.969342    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-978d92-29736810-r26x8"]
Jul 16 13:33:44.168648 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.168589    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:33:44.313887 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.313845    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm4v6\" (UniqueName: \"kubernetes.io/projected/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-kube-api-access-cm4v6\") pod \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") "
Jul 16 13:33:44.314091 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.313979    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-openshift-service-ca\") pod \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") "
Jul 16 13:33:44.314091 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.314010    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls\") pod \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\" (UID: \"ad67df23-5a4a-475f-9e82-e5eb56a8a08b\") "
Jul 16 13:33:44.314368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.314345    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad67df23-5a4a-475f-9e82-e5eb56a8a08b" (UID: "ad67df23-5a4a-475f-9e82-e5eb56a8a08b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:33:44.315967 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.315943    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-kube-api-access-cm4v6" (OuterVolumeSpecName: "kube-api-access-cm4v6") pod "ad67df23-5a4a-475f-9e82-e5eb56a8a08b" (UID: "ad67df23-5a4a-475f-9e82-e5eb56a8a08b"). InnerVolumeSpecName "kube-api-access-cm4v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:33:44.316068 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.315978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad67df23-5a4a-475f-9e82-e5eb56a8a08b" (UID: "ad67df23-5a4a-475f-9e82-e5eb56a8a08b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:33:44.386914 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.386881    2564 generic.go:356] "Generic (PLEG): container finished" podID="ad67df23-5a4a-475f-9e82-e5eb56a8a08b" containerID="9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3" exitCode=0
Jul 16 13:33:44.387090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.386929    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"
Jul 16 13:33:44.387090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.386972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9" event={"ID":"ad67df23-5a4a-475f-9e82-e5eb56a8a08b","Type":"ContainerDied","Data":"9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3"}
Jul 16 13:33:44.387090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.387025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9" event={"ID":"ad67df23-5a4a-475f-9e82-e5eb56a8a08b","Type":"ContainerDied","Data":"be8510b25af1841c7961487aea7dae6d05bf7c53065f1c281bcf9c62bcff2981"}
Jul 16 13:33:44.387090 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.387050    2564 scope.go:117] "RemoveContainer" containerID="9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3"
Jul 16 13:33:44.397172 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.397154    2564 scope.go:117] "RemoveContainer" containerID="9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3"
Jul 16 13:33:44.397433 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:33:44.397411    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3\": container with ID starting with 9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3 not found: ID does not exist" containerID="9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3"
Jul 16 13:33:44.397501 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.397446    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3"} err="failed to get container status \"9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3\": rpc error: code = NotFound desc = could not find container \"9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3\": container with ID starting with 9de9c0fdd02f46d3cdea8937cc56d265c022f44b52c146989cf16742d7df84d3 not found: ID does not exist"
Jul 16 13:33:44.412703 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.412679    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"]
Jul 16 13:33:44.415310 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.415276    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:33:44.415310 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.415304    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:33:44.415489 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.415319    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm4v6\" (UniqueName: \"kubernetes.io/projected/ad67df23-5a4a-475f-9e82-e5eb56a8a08b-kube-api-access-cm4v6\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:33:44.417587 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.417567    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-978d92-cffbb5f54-db6k9"]
Jul 16 13:33:44.834520 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.834485    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c26431-10a7-4236-8d97-90314e9a522b" path="/var/lib/kubelet/pods/a9c26431-10a7-4236-8d97-90314e9a522b/volumes"
Jul 16 13:33:44.834856 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:44.834844    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad67df23-5a4a-475f-9e82-e5eb56a8a08b" path="/var/lib/kubelet/pods/ad67df23-5a4a-475f-9e82-e5eb56a8a08b/volumes"
Jul 16 13:33:48.474995 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:48.474968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:55.449065 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:55.449032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:55.552691 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:55.552660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:59.202384 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.202348    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"]
Jul 16 13:33:59.202897 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.202550    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy" containerID="cri-o://aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6" gracePeriod=30
Jul 16 13:33:59.230658 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.230620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:59.474963 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.474870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:33:59.593741 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.593706    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"]
Jul 16 13:33:59.594131 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.594117    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad67df23-5a4a-475f-9e82-e5eb56a8a08b" containerName="maas-api"
Jul 16 13:33:59.594186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.594133    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad67df23-5a4a-475f-9e82-e5eb56a8a08b" containerName="maas-api"
Jul 16 13:33:59.594186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.594147    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3" containerName="revoke-keys"
Jul 16 13:33:59.594186 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.594153    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3" containerName="revoke-keys"
Jul 16 13:33:59.594286 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.594219    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3" containerName="revoke-keys"
Jul 16 13:33:59.594286 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.594229    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad67df23-5a4a-475f-9e82-e5eb56a8a08b" containerName="maas-api"
Jul 16 13:33:59.597274 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.597247    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"
Jul 16 13:33:59.599280 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.599252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"]
Jul 16 13:33:59.599874 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.599852    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9kff4\""
Jul 16 13:33:59.650459 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.650420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab0aad9d-6a36-4296-aeda-3eee317d0635-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g\" (UID: \"ab0aad9d-6a36-4296-aeda-3eee317d0635\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"
Jul 16 13:33:59.751552 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.751450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab0aad9d-6a36-4296-aeda-3eee317d0635-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g\" (UID: \"ab0aad9d-6a36-4296-aeda-3eee317d0635\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"
Jul 16 13:33:59.752078 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.752058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab0aad9d-6a36-4296-aeda-3eee317d0635-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g\" (UID: \"ab0aad9d-6a36-4296-aeda-3eee317d0635\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"
Jul 16 13:33:59.909436 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:33:59.909402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"
Jul 16 13:34:00.055013 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:00.054983    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"]
Jul 16 13:34:00.057565 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:34:00.057518    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0aad9d_6a36_4296_aeda_3eee317d0635.slice/crio-7831decc2ac2a608c4af8b4a0e5c5aa8e484b83c986c054c5eb88316417e21da WatchSource:0}: Error finding container 7831decc2ac2a608c4af8b4a0e5c5aa8e484b83c986c054c5eb88316417e21da: Status 404 returned error can't find the container with id 7831decc2ac2a608c4af8b4a0e5c5aa8e484b83c986c054c5eb88316417e21da
Jul 16 13:34:00.195726 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:00.195692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:00.293499 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:00.293453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:00.477764 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:00.477722    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g" event={"ID":"ab0aad9d-6a36-4296-aeda-3eee317d0635","Type":"ContainerStarted","Data":"bc046d01d18a92dbac2300c5093c60bce8fea00ed695c5e0d68d52a91ac382f6"}
Jul 16 13:34:00.477947 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:00.477787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g" event={"ID":"ab0aad9d-6a36-4296-aeda-3eee317d0635","Type":"ContainerStarted","Data":"7831decc2ac2a608c4af8b4a0e5c5aa8e484b83c986c054c5eb88316417e21da"}
Jul 16 13:34:00.507358 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:00.507297    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g" podStartSLOduration=1.507277682 podStartE2EDuration="1.507277682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:34:00.506101502 +0000 UTC m=+2924.245091293" watchObservedRunningTime="2026-07-16 13:34:00.507277682 +0000 UTC m=+2924.246267461"
Jul 16 13:34:01.484800 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:01.484768    2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0aad9d-6a36-4296-aeda-3eee317d0635" containerID="bc046d01d18a92dbac2300c5093c60bce8fea00ed695c5e0d68d52a91ac382f6" exitCode=0
Jul 16 13:34:01.485188 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:01.484846    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g" event={"ID":"ab0aad9d-6a36-4296-aeda-3eee317d0635","Type":"ContainerDied","Data":"bc046d01d18a92dbac2300c5093c60bce8fea00ed695c5e0d68d52a91ac382f6"}
Jul 16 13:34:02.628449 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:02.628423    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"
Jul 16 13:34:02.673628 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:02.673597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab0aad9d-6a36-4296-aeda-3eee317d0635-maas-api-service-ca\") pod \"ab0aad9d-6a36-4296-aeda-3eee317d0635\" (UID: \"ab0aad9d-6a36-4296-aeda-3eee317d0635\") "
Jul 16 13:34:02.673958 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:02.673935    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0aad9d-6a36-4296-aeda-3eee317d0635-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab0aad9d-6a36-4296-aeda-3eee317d0635" (UID: "ab0aad9d-6a36-4296-aeda-3eee317d0635"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:34:02.774438 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:02.774347    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab0aad9d-6a36-4296-aeda-3eee317d0635-maas-api-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:03.497101 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:03.497072    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g"
Jul 16 13:34:03.497295 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:03.497097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g" event={"ID":"ab0aad9d-6a36-4296-aeda-3eee317d0635","Type":"ContainerDied","Data":"7831decc2ac2a608c4af8b4a0e5c5aa8e484b83c986c054c5eb88316417e21da"}
Jul 16 13:34:03.497295 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:03.497167    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7831decc2ac2a608c4af8b4a0e5c5aa8e484b83c986c054c5eb88316417e21da"
Jul 16 13:34:04.463497 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.463438    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:34:04.487711 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487677    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhgc9\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-kube-api-access-jhgc9\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.487880 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487729    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-data\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.487880 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487755    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-envoy\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.487880 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487786    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/045c2707-99c2-40bc-81a2-62e5bd7ff156-istiod-ca-cert\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.487880 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-token\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.487880 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487862    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-socket\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.488184 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487902    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-credential-socket\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.488184 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-podinfo\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.488184 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.487978    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-certs\") pod \"045c2707-99c2-40bc-81a2-62e5bd7ff156\" (UID: \"045c2707-99c2-40bc-81a2-62e5bd7ff156\") "
Jul 16 13:34:04.488341 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.488182    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:34:04.488341 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.488272    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:34:04.488341 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.488319    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.488478 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.488394    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:34:04.488533 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.488474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/045c2707-99c2-40bc-81a2-62e5bd7ff156-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:34:04.488758 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.488736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-data" (OuterVolumeSpecName: "istio-data") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:34:04.490537 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.490482    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-token" (OuterVolumeSpecName: "istio-token") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:34:04.491166 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.491144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-kube-api-access-jhgc9" (OuterVolumeSpecName: "kube-api-access-jhgc9") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "kube-api-access-jhgc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:34:04.491261 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.491223    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 13:34:04.491736 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.491710    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "045c2707-99c2-40bc-81a2-62e5bd7ff156" (UID: "045c2707-99c2-40bc-81a2-62e5bd7ff156"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:34:04.505918 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.505891    2564 generic.go:356] "Generic (PLEG): container finished" podID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerID="aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6" exitCode=0
Jul 16 13:34:04.506049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.505960    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"
Jul 16 13:34:04.506049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.505983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" event={"ID":"045c2707-99c2-40bc-81a2-62e5bd7ff156","Type":"ContainerDied","Data":"aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6"}
Jul 16 13:34:04.506049 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.506045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429" event={"ID":"045c2707-99c2-40bc-81a2-62e5bd7ff156","Type":"ContainerDied","Data":"97c5f8cc402ab03fdcb5406122e0e033bd9e269a6beac706bd42e3c67b417201"}
Jul 16 13:34:04.506185 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.506069    2564 scope.go:117] "RemoveContainer" containerID="aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6"
Jul 16 13:34:04.515432 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.515413    2564 scope.go:117] "RemoveContainer" containerID="b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3"
Jul 16 13:34:04.523809 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.523789    2564 scope.go:117] "RemoveContainer" containerID="aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6"
Jul 16 13:34:04.524098 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:34:04.524079    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6\": container with ID starting with aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6 not found: ID does not exist" containerID="aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6"
Jul 16 13:34:04.524172 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.524122    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6"} err="failed to get container status \"aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6\": rpc error: code = NotFound desc = could not find container \"aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6\": container with ID starting with aaf168ceacac26b476a1eac8b9ebeaaddb772517ded189ec498271e1a12a68b6 not found: ID does not exist"
Jul 16 13:34:04.524172 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.524146    2564 scope.go:117] "RemoveContainer" containerID="b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3"
Jul 16 13:34:04.524417 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:34:04.524396    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3\": container with ID starting with b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3 not found: ID does not exist" containerID="b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3"
Jul 16 13:34:04.524473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.524428    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3"} err="failed to get container status \"b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3\": rpc error: code = NotFound desc = could not find container \"b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3\": container with ID starting with b9566128d71766c0c0938f3621bb05412103e683c1028b2a52cabfd670c094e3 not found: ID does not exist"
Jul 16 13:34:04.534667 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.534638    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"]
Jul 16 13:34:04.539339 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.539315    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-978d92-openshift-default-69db48b6ff-bh429"]
Jul 16 13:34:04.588764 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588729    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.588764 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588759    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-credential-socket\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.588764 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588768    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-podinfo\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.588975 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588779    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-workload-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.588975 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588788    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhgc9\" (UniqueName: \"kubernetes.io/projected/045c2707-99c2-40bc-81a2-62e5bd7ff156-kube-api-access-jhgc9\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.588975 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588796    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-data\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.588975 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588804    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/045c2707-99c2-40bc-81a2-62e5bd7ff156-istio-envoy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.588975 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.588811    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/045c2707-99c2-40bc-81a2-62e5bd7ff156-istiod-ca-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:04.840276 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:04.840248    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" path="/var/lib/kubelet/pods/045c2707-99c2-40bc-81a2-62e5bd7ff156/volumes"
Jul 16 13:34:10.446743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.446696    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"]
Jul 16 13:34:10.447277 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.446943    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm" podUID="f29be06d-55b9-4a87-a8d1-8675db0397d9" containerName="maas-api" containerID="cri-o://c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195" gracePeriod=30
Jul 16 13:34:10.479749 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.479715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:10.488691 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.488649    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"]
Jul 16 13:34:10.492473 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.492447    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c7dd05-29736810-7sw76"]
Jul 16 13:34:10.699900 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.699829    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:34:10.742743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.742709    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls\") pod \"f29be06d-55b9-4a87-a8d1-8675db0397d9\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") "
Jul 16 13:34:10.742743 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.742745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29be06d-55b9-4a87-a8d1-8675db0397d9-openshift-service-ca\") pod \"f29be06d-55b9-4a87-a8d1-8675db0397d9\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") "
Jul 16 13:34:10.743011 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.742782    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs6h9\" (UniqueName: \"kubernetes.io/projected/f29be06d-55b9-4a87-a8d1-8675db0397d9-kube-api-access-hs6h9\") pod \"f29be06d-55b9-4a87-a8d1-8675db0397d9\" (UID: \"f29be06d-55b9-4a87-a8d1-8675db0397d9\") "
Jul 16 13:34:10.743160 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.743134    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f29be06d-55b9-4a87-a8d1-8675db0397d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f29be06d-55b9-4a87-a8d1-8675db0397d9" (UID: "f29be06d-55b9-4a87-a8d1-8675db0397d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:34:10.744848 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.744822    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f29be06d-55b9-4a87-a8d1-8675db0397d9" (UID: "f29be06d-55b9-4a87-a8d1-8675db0397d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:34:10.744965 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.744880    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f29be06d-55b9-4a87-a8d1-8675db0397d9-kube-api-access-hs6h9" (OuterVolumeSpecName: "kube-api-access-hs6h9") pod "f29be06d-55b9-4a87-a8d1-8675db0397d9" (UID: "f29be06d-55b9-4a87-a8d1-8675db0397d9"). InnerVolumeSpecName "kube-api-access-hs6h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:34:10.841495 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.841446    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a92b63ed-ff04-4d57-8bb7-26443cb85d46" path="/var/lib/kubelet/pods/a92b63ed-ff04-4d57-8bb7-26443cb85d46/volumes"
Jul 16 13:34:10.843433 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.843411    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f29be06d-55b9-4a87-a8d1-8675db0397d9-maas-api-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:10.843501 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.843437    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29be06d-55b9-4a87-a8d1-8675db0397d9-openshift-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:10.843501 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:10.843448    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs6h9\" (UniqueName: \"kubernetes.io/projected/f29be06d-55b9-4a87-a8d1-8675db0397d9-kube-api-access-hs6h9\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\""
Jul 16 13:34:11.548543 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.548510    2564 generic.go:356] "Generic (PLEG): container finished" podID="f29be06d-55b9-4a87-a8d1-8675db0397d9" containerID="c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195" exitCode=0
Jul 16 13:34:11.549011 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.548548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm" event={"ID":"f29be06d-55b9-4a87-a8d1-8675db0397d9","Type":"ContainerDied","Data":"c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195"}
Jul 16 13:34:11.549011 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.548565    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"
Jul 16 13:34:11.549011 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.548588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm" event={"ID":"f29be06d-55b9-4a87-a8d1-8675db0397d9","Type":"ContainerDied","Data":"01f5a2991cb15759007667424681cc5b0fed904d7e9446bfa1873170ebd66771"}
Jul 16 13:34:11.549011 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.548611    2564 scope.go:117] "RemoveContainer" containerID="c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195"
Jul 16 13:34:11.557558 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.557537    2564 scope.go:117] "RemoveContainer" containerID="c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195"
Jul 16 13:34:11.557827 ip-10-0-131-226 kubenswrapper[2564]: E0716 13:34:11.557806    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195\": container with ID starting with c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195 not found: ID does not exist" containerID="c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195"
Jul 16 13:34:11.557870 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.557836    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195"} err="failed to get container status \"c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195\": rpc error: code = NotFound desc = could not find container \"c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195\": container with ID starting with c9cb6f7f20e250acf44c2400efc7decfd3ad213723f7195146c53894b459a195 not found: ID does not exist"
Jul 16 13:34:11.570381 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.570349    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"]
Jul 16 13:34:11.580914 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:11.580885    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c7dd05-fd6d4675-2httm"]
Jul 16 13:34:12.834351 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:12.834321    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f29be06d-55b9-4a87-a8d1-8675db0397d9" path="/var/lib/kubelet/pods/f29be06d-55b9-4a87-a8d1-8675db0397d9/volumes"
Jul 16 13:34:14.764021 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:14.763985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:21.859395 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:21.859360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:21.927781 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:21.927747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:25.466921 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:25.466881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:25.704536 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:25.704504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:31.687722 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:31.687679    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7rs4d_0b885a09-9890-4c4d-9834-71ff926031af/manager/0.log"
Jul 16 13:34:31.810855 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:31.810822    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sz4th_b2de5e96-d219-403b-9349-5b33199060a7/manager/0.log"
Jul 16 13:34:31.934752 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:31.934715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55f9cb4fbd-5g2mw_0b1e9814-87cf-4e33-8414-76e13ea0d6f3/manager/0.log"
Jul 16 13:34:32.055566 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:32.055487    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7w6cl_cc753de1-bd18-4e22-b04f-d74a33f2ea80/server/0.log"
Jul 16 13:34:32.177433 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:32.177403    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rht72_50c0d85c-c3f3-4ee3-a486-170aa0041584/manager/0.log"
Jul 16 13:34:32.302561 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:32.302533    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d668944c-7cjzb_acfe6a99-c379-4605-8f0c-0bf32e1841fb/copy-manifests/0.log"
Jul 16 13:34:32.321647 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:32.321579    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d668944c-7cjzb_acfe6a99-c379-4605-8f0c-0bf32e1841fb/manager/0.log"
Jul 16 13:34:32.972491 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:32.972459    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-794579b75-9hdcd_4a2bb59f-4c01-4b98-8509-a410fb6e9573/maas-api/0.log"
Jul 16 13:34:33.101765 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:33.101736    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736780-85r7b_99cf2572-ac8e-4bcf-8c00-aba0ac0f5934/cleanup/0.log"
Jul 16 13:34:33.235166 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:33.235077    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736795-z46g8_8ae8292f-01d9-41f5-9e45-ca72d878104a/cleanup/0.log"
Jul 16 13:34:33.354633 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:33.354606    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736810-666fn_db099e06-afd7-4409-b08a-b8f48bfc8500/cleanup/0.log"
Jul 16 13:34:33.498785 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:33.498717    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-0428f520-pj54z_309ab0dc-285f-44a6-a2d3-d93cec74fc5d/revoke-keys/0.log"
Jul 16 13:34:33.628471 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:33.628444    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-77899ed4-q89b9_58c60f7f-9c79-47bc-8cef-8dc444e594ab/revoke-keys/0.log"
Jul 16 13:34:33.994550 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:33.994519    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-2177a147-pv7vz_4c47837a-f61a-48d4-a187-e84317deb418/revoke-keys/0.log"
Jul 16 13:34:34.362234 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:34.362208    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-f8d4b9eb-n6mc8_f5b2b2ba-e211-47f0-b4ca-f16b9eb188dc/revoke-keys/0.log"
Jul 16 13:34:34.495870 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:34.495837    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-1af4e64f-8lwwm_769b5008-b397-4c55-9e17-ec6b3cdf841e/revoke-keys/0.log"
Jul 16 13:34:34.614023 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:34.613955    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-a1f86fcf-s6mf2_03d02fb8-d87f-4902-8759-43f5774d13c7/revoke-keys/0.log"
Jul 16 13:34:34.747547 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:34.747510    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-978d92-xdb9t_ffedb6f3-f1b1-4e6a-80f3-9a8d0a3b11a3/revoke-keys/0.log"
Jul 16 13:34:34.861777 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:34.861749    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-c7dd05-zp82g_ab0aad9d-6a36-4296-aeda-3eee317d0635/revoke-keys/0.log"
Jul 16 13:34:34.985679 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:34.985594    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-pmf2r_863fc512-6f9d-480d-9509-25ac800ac636/postgres/0.log"
Jul 16 13:34:37.087975 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:37.087944    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9tj5p_bac3cea1-5168-4908-b352-a5ed05890d16/manager/0.log"
Jul 16 13:34:37.872180 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:37.872153    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bkwr2_fb816cf6-da84-4bb5-bee7-a697e84ed531/discovery/0.log"
Jul 16 13:34:38.109313 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:38.109286    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d67ccd5b7-vkk28_aa831b28-d565-4888-a419-cd7dbfac718d/kube-auth-proxy/0.log"
Jul 16 13:34:38.372567 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:38.372539    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-f5qdm_d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a/payload-pre-processing/0.log"
Jul 16 13:34:38.496093 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:38.496057    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-bh7dp_5d83a672-e6c7-4562-a0f7-676b7f9e0bea/payload-processing/0.log"
Jul 16 13:34:38.981494 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:38.981466    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-knjqq_06a7b5b7-f21f-4ca4-8a20-1573da5edbe4/main/0.log"
Jul 16 13:34:39.093405 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:39.093369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:39.195350 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:39.195319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:45.695624 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.695586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:45.759167 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759137    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljjhv/must-gather-qdgrh"]
Jul 16 13:34:45.759528 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759516    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f29be06d-55b9-4a87-a8d1-8675db0397d9" containerName="maas-api"
Jul 16 13:34:45.759571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759529    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f29be06d-55b9-4a87-a8d1-8675db0397d9" containerName="maas-api"
Jul 16 13:34:45.759571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759542    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy"
Jul 16 13:34:45.759571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759547    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy"
Jul 16 13:34:45.759571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759557    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0aad9d-6a36-4296-aeda-3eee317d0635" containerName="revoke-keys"
Jul 16 13:34:45.759571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759563    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0aad9d-6a36-4296-aeda-3eee317d0635" containerName="revoke-keys"
Jul 16 13:34:45.759571 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759570    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy"
Jul 16 13:34:45.759755 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759576    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy"
Jul 16 13:34:45.759755 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759625    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy"
Jul 16 13:34:45.759755 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759634    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f29be06d-55b9-4a87-a8d1-8675db0397d9" containerName="maas-api"
Jul 16 13:34:45.759755 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759644    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0aad9d-6a36-4296-aeda-3eee317d0635" containerName="revoke-keys"
Jul 16 13:34:45.759755 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.759756    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="045c2707-99c2-40bc-81a2-62e5bd7ff156" containerName="istio-proxy"
Jul 16 13:34:45.763072 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.763053    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:45.772290 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.772273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljjhv\"/\"kube-root-ca.crt\""
Jul 16 13:34:45.772381 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.772326    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ljjhv\"/\"default-dockercfg-t5vwb\""
Jul 16 13:34:45.772381 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.772347    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljjhv\"/\"openshift-service-ca.crt\""
Jul 16 13:34:45.785783 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.785740    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljjhv/must-gather-qdgrh"]
Jul 16 13:34:45.855511 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.855479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhr2z\" (UniqueName: \"kubernetes.io/projected/e8265637-acfe-453d-896e-7dbad8a1e837-kube-api-access-bhr2z\") pod \"must-gather-qdgrh\" (UID: \"e8265637-acfe-453d-896e-7dbad8a1e837\") " pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:45.855679 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.855533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e8265637-acfe-453d-896e-7dbad8a1e837-must-gather-output\") pod \"must-gather-qdgrh\" (UID: \"e8265637-acfe-453d-896e-7dbad8a1e837\") " pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:45.956368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.956280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhr2z\" (UniqueName: \"kubernetes.io/projected/e8265637-acfe-453d-896e-7dbad8a1e837-kube-api-access-bhr2z\") pod \"must-gather-qdgrh\" (UID: \"e8265637-acfe-453d-896e-7dbad8a1e837\") " pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:45.956368 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.956346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e8265637-acfe-453d-896e-7dbad8a1e837-must-gather-output\") pod \"must-gather-qdgrh\" (UID: \"e8265637-acfe-453d-896e-7dbad8a1e837\") " pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:45.956649 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.956630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e8265637-acfe-453d-896e-7dbad8a1e837-must-gather-output\") pod \"must-gather-qdgrh\" (UID: \"e8265637-acfe-453d-896e-7dbad8a1e837\") " pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:45.986834 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:45.986802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhr2z\" (UniqueName: \"kubernetes.io/projected/e8265637-acfe-453d-896e-7dbad8a1e837-kube-api-access-bhr2z\") pod \"must-gather-qdgrh\" (UID: \"e8265637-acfe-453d-896e-7dbad8a1e837\") " pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:46.072056 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:46.072020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljjhv/must-gather-qdgrh"
Jul 16 13:34:46.238526 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:46.238500    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljjhv/must-gather-qdgrh"]
Jul 16 13:34:46.240689 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:34:46.240662    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8265637_acfe_453d_896e_7dbad8a1e837.slice/crio-4400af41bdefaf9bc33a421ecd4dca4a8e6e8173a955ed8ce5dae67dfe5dc82b WatchSource:0}: Error finding container 4400af41bdefaf9bc33a421ecd4dca4a8e6e8173a955ed8ce5dae67dfe5dc82b: Status 404 returned error can't find the container with id 4400af41bdefaf9bc33a421ecd4dca4a8e6e8173a955ed8ce5dae67dfe5dc82b
Jul 16 13:34:46.242581 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:46.242563    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 13:34:46.737929 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:46.737892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljjhv/must-gather-qdgrh" event={"ID":"e8265637-acfe-453d-896e-7dbad8a1e837","Type":"ContainerStarted","Data":"4400af41bdefaf9bc33a421ecd4dca4a8e6e8173a955ed8ce5dae67dfe5dc82b"}
Jul 16 13:34:46.870178 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:46.870128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log" limit=1024
Jul 16 13:34:47.747823 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:47.747776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljjhv/must-gather-qdgrh" event={"ID":"e8265637-acfe-453d-896e-7dbad8a1e837","Type":"ContainerStarted","Data":"e0aadc3789cdeab28a8e89993d5209393af00483910fc435bd291356b6e85c24"}
Jul 16 13:34:47.748462 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:47.748414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljjhv/must-gather-qdgrh" event={"ID":"e8265637-acfe-453d-896e-7dbad8a1e837","Type":"ContainerStarted","Data":"64aae006583febc58a8f8a737757bb728802c319ba0020c3692cb74bd1cd13fc"}
Jul 16 13:34:47.774658 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:47.774584    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ljjhv/must-gather-qdgrh" podStartSLOduration=1.952314217 podStartE2EDuration="2.774561059s" totalImagesPullingTime="822.246842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:34:47.769481107 +0000 UTC m=+2971.508470889" watchObservedRunningTime="2026-07-16 13:34:47.774561059 +0000 UTC m=+2971.513550839"
Jul 16 13:34:49.224001 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:49.223972    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qc2j4_37e50b87-c3e2-45fb-8c7e-7fd07471b20e/global-pull-secret-syncer/0.log"
Jul 16 13:34:49.377086 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:49.377053    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7fvbf_3ecee6e5-846a-40a8-9e97-4a3b4e81b94e/konnectivity-agent/0.log"
Jul 16 13:34:49.499275 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:49.499203    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-226.ec2.internal_62d0507dd5f34f08d10a81f149614966/haproxy/0.log"
Jul 16 13:34:55.232695 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:55.231862    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9tj5p_bac3cea1-5168-4908-b352-a5ed05890d16/manager/0.log"
Jul 16 13:34:56.935401 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:56.935368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b15d9fba-1fc5-4989-8803-c6c8fabc2c5b/alertmanager/0.log"
Jul 16 13:34:57.001231 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.001199    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b15d9fba-1fc5-4989-8803-c6c8fabc2c5b/config-reloader/0.log"
Jul 16 13:34:57.051656 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.051618    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b15d9fba-1fc5-4989-8803-c6c8fabc2c5b/kube-rbac-proxy-web/0.log"
Jul 16 13:34:57.107850 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.107776    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b15d9fba-1fc5-4989-8803-c6c8fabc2c5b/kube-rbac-proxy/0.log"
Jul 16 13:34:57.166067 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.166025    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b15d9fba-1fc5-4989-8803-c6c8fabc2c5b/kube-rbac-proxy-metric/0.log"
Jul 16 13:34:57.210866 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.210777    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b15d9fba-1fc5-4989-8803-c6c8fabc2c5b/prom-label-proxy/0.log"
Jul 16 13:34:57.255229 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.255200    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b15d9fba-1fc5-4989-8803-c6c8fabc2c5b/init-config-reloader/0.log"
Jul 16 13:34:57.941142 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.941094    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckng5_ed107659-4317-4061-89c0-08eec3dbce21/node-exporter/0.log"
Jul 16 13:34:57.985316 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:57.985292    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckng5_ed107659-4317-4061-89c0-08eec3dbce21/kube-rbac-proxy/0.log"
Jul 16 13:34:58.041678 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:58.041645    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckng5_ed107659-4317-4061-89c0-08eec3dbce21/init-textfile/0.log"
Jul 16 13:34:59.399783 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.399752    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f7677775-8vhfx_7592045e-7895-45c1-bad3-7cb42ecc3ff6/thanos-query/0.log"
Jul 16 13:34:59.472092 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.472050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f7677775-8vhfx_7592045e-7895-45c1-bad3-7cb42ecc3ff6/kube-rbac-proxy-web/0.log"
Jul 16 13:34:59.576066 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.576028    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f7677775-8vhfx_7592045e-7895-45c1-bad3-7cb42ecc3ff6/kube-rbac-proxy/0.log"
Jul 16 13:34:59.644694 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.644650    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"]
Jul 16 13:34:59.650207 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.650135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.674531 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.674496    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"]
Jul 16 13:34:59.678767 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.678746    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f7677775-8vhfx_7592045e-7895-45c1-bad3-7cb42ecc3ff6/prom-label-proxy/0.log"
Jul 16 13:34:59.793694 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.793655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-lib-modules\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.793887 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.793784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j75b\" (UniqueName: \"kubernetes.io/projected/ac613854-2461-409e-91cb-223f619669dd-kube-api-access-7j75b\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.793887 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.793820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-sys\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.794015 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.793915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-proc\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.794015 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.793988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-podres\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.807447 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.807412    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f7677775-8vhfx_7592045e-7895-45c1-bad3-7cb42ecc3ff6/kube-rbac-proxy-rules/0.log"
Jul 16 13:34:59.895432 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-lib-modules\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895432 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j75b\" (UniqueName: \"kubernetes.io/projected/ac613854-2461-409e-91cb-223f619669dd-kube-api-access-7j75b\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895637 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-sys\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895637 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-proc\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895637 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-podres\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895637 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-lib-modules\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895637 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-proc\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895637 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-sys\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.895825 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.895638    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac613854-2461-409e-91cb-223f619669dd-podres\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.919309 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.919234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j75b\" (UniqueName: \"kubernetes.io/projected/ac613854-2461-409e-91cb-223f619669dd-kube-api-access-7j75b\") pod \"perf-node-gather-daemonset-jlh4h\" (UID: \"ac613854-2461-409e-91cb-223f619669dd\") " pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:34:59.919309 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.919255    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f7677775-8vhfx_7592045e-7895-45c1-bad3-7cb42ecc3ff6/kube-rbac-proxy-metrics/0.log"
Jul 16 13:34:59.962178 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:34:59.962142    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:35:00.166729 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:00.166705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"]
Jul 16 13:35:00.168881 ip-10-0-131-226 kubenswrapper[2564]: W0716 13:35:00.168854    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac613854_2461_409e_91cb_223f619669dd.slice/crio-535731c01f99dd7407b2eb95d154f937c2f3efdaa3ebaa6d7aaa1c33bf79fdda WatchSource:0}: Error finding container 535731c01f99dd7407b2eb95d154f937c2f3efdaa3ebaa6d7aaa1c33bf79fdda: Status 404 returned error can't find the container with id 535731c01f99dd7407b2eb95d154f937c2f3efdaa3ebaa6d7aaa1c33bf79fdda
Jul 16 13:35:00.857398 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:00.857356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h" event={"ID":"ac613854-2461-409e-91cb-223f619669dd","Type":"ContainerStarted","Data":"6a37786ae17f8eaaaadac0ec4802c3bb8e5081d64d5ad5db7b2115deafb87fde"}
Jul 16 13:35:00.857882 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:00.857408    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h" event={"ID":"ac613854-2461-409e-91cb-223f619669dd","Type":"ContainerStarted","Data":"535731c01f99dd7407b2eb95d154f937c2f3efdaa3ebaa6d7aaa1c33bf79fdda"}
Jul 16 13:35:00.857882 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:00.857535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:35:05.223662 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:05.223631    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jt7hf_7efedfaf-ec54-49bc-ba3c-08bb873abd11/dns/0.log"
Jul 16 13:35:05.270043 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:05.270013    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jt7hf_7efedfaf-ec54-49bc-ba3c-08bb873abd11/kube-rbac-proxy/0.log"
Jul 16 13:35:05.344290 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:05.344250    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b89fz_0ce6d3aa-0d83-4ade-865f-d37af2041004/dns-node-resolver/0.log"
Jul 16 13:35:06.203315 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:06.203284    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7c9x4_8137dd54-1895-4825-8bd3-9f1a1c333487/node-ca/0.log"
Jul 16 13:35:06.874874 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:06.874840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h"
Jul 16 13:35:06.910346 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:06.910293    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ljjhv/perf-node-gather-daemonset-jlh4h" podStartSLOduration=7.910275518 podStartE2EDuration="7.910275518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:35:00.890914283 +0000 UTC m=+2984.629904063" watchObservedRunningTime="2026-07-16 13:35:06.910275518 +0000 UTC m=+2990.649265297"
Jul 16 13:35:07.735332 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:07.735299    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bkwr2_fb816cf6-da84-4bb5-bee7-a697e84ed531/discovery/0.log"
Jul 16 13:35:07.810305 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:07.810276    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d67ccd5b7-vkk28_aa831b28-d565-4888-a419-cd7dbfac718d/kube-auth-proxy/0.log"
Jul 16 13:35:07.942067 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:07.942034    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-f5qdm_d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a/payload-pre-processing/0.log"
Jul 16 13:35:07.997623 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:07.997537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-bh7dp_5d83a672-e6c7-4562-a0f7-676b7f9e0bea/payload-processing/0.log"
Jul 16 13:35:09.128691 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:09.128664    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h882t_a8539430-4cf2-4ec5-8f2e-f285fade1f8d/serve-healthcheck-canary/0.log"
Jul 16 13:35:09.581988 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:09.581907    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bkwr2_fb816cf6-da84-4bb5-bee7-a697e84ed531/discovery/0.log"
Jul 16 13:35:09.641312 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:09.641283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d67ccd5b7-vkk28_aa831b28-d565-4888-a419-cd7dbfac718d/kube-auth-proxy/0.log"
Jul 16 13:35:09.749972 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:09.749938    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-f5qdm_d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a/payload-pre-processing/0.log"
Jul 16 13:35:09.794926 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:09.794887    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-bh7dp_5d83a672-e6c7-4562-a0f7-676b7f9e0bea/payload-processing/0.log"
Jul 16 13:35:09.952976 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:09.952951    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-68f8v_bdda2b5b-0eec-4991-864d-10550483dc57/kube-rbac-proxy/0.log"
Jul 16 13:35:10.023789 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:10.023747    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-68f8v_bdda2b5b-0eec-4991-864d-10550483dc57/exporter/0.log"
Jul 16 13:35:10.084309 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:10.084272    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-68f8v_bdda2b5b-0eec-4991-864d-10550483dc57/extractor/0.log"
Jul 16 13:35:11.165994 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:11.165958    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bkwr2_fb816cf6-da84-4bb5-bee7-a697e84ed531/discovery/0.log"
Jul 16 13:35:11.221906 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:11.221871    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d67ccd5b7-vkk28_aa831b28-d565-4888-a419-cd7dbfac718d/kube-auth-proxy/0.log"
Jul 16 13:35:11.321614 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:11.321421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-f5qdm_d3e40d13-ef7b-4e5d-9d53-0bc1107ed51a/payload-pre-processing/0.log"
Jul 16 13:35:11.377765 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:11.377738    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-bh7dp_5d83a672-e6c7-4562-a0f7-676b7f9e0bea/payload-processing/0.log"
Jul 16 13:35:13.007688 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:13.007660    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7rs4d_0b885a09-9890-4c4d-9834-71ff926031af/manager/0.log"
Jul 16 13:35:13.194272 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:13.194240    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sz4th_b2de5e96-d219-403b-9349-5b33199060a7/manager/0.log"
Jul 16 13:35:13.409583 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:13.409550    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55f9cb4fbd-5g2mw_0b1e9814-87cf-4e33-8414-76e13ea0d6f3/manager/0.log"
Jul 16 13:35:13.480632 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:13.480606    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7w6cl_cc753de1-bd18-4e22-b04f-d74a33f2ea80/server/0.log"
Jul 16 13:35:13.572415 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:13.572383    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rht72_50c0d85c-c3f3-4ee3-a486-170aa0041584/manager/0.log"
Jul 16 13:35:13.632641 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:13.632606    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d668944c-7cjzb_acfe6a99-c379-4605-8f0c-0bf32e1841fb/manager/0.log"
Jul 16 13:35:13.707995 ip-10-0-131-226 kubenswrapper[2564]: I0716 13:35:13.707925    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d668944c-7cjzb_acfe6a99-c379-4605-8f0c-0bf32e1841fb/copy-manifests/0.log"