Jul 29 19:15:05.985856 ip-10-0-131-202 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 19:15:06.405063 ip-10-0-131-202 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:15:06.405063 ip-10-0-131-202 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 19:15:06.405063 ip-10-0-131-202 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:15:06.405063 ip-10-0-131-202 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 19:15:06.405063 ip-10-0-131-202 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:15:06.407412 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.407247    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 19:15:06.414349 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414327    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.414349 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414346    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.414349 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414351    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.414349 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414356    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414361    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414366    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414371    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414375    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414381    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414385    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414389    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414393    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414400    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414406    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414409    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414413    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414418    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414421    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414433    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414438    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414443    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414447    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414451    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.414611 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414456    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414460    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414465    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414469    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414473    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414478    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414482    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414487    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414492    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414497    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414501    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414505    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414510    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414515    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414520    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414526    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414533    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414537    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414542    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.415522 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414547    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414552    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414556    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414562    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414567    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414571    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414576    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414581    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414588    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414595    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414600    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414605    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414610    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414614    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414638    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414642    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414647    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414652    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414656    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.416394 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414661    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414665    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414670    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414674    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414679    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414683    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414693    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414699    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414706    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414711    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414722    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414728    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414733    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414737    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414742    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414746    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414751    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414756    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414760    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414766    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.417273 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414773    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414778    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414783    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414788    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414793    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414797    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414802    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414807    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414812    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414816    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414821    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414825    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414830    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414834    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414838    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414844    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414849    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.414853    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416199    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416210    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.418206 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416216    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416221    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416226    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416232    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416237    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416241    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416246    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416252    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416256    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416261    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416265    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416270    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416275    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416280    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416284    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416289    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416294    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416298    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416303    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416307    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.419127 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416312    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416316    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416321    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416327    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416334    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416341    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416346    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416350    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416356    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416361    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416366    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416373    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416378    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416383    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416387    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416391    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416399    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416404    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416409    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416413    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.420014 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416418    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416422    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416426    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416431    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416436    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416441    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416447    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416452    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416457    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416462    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416467    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416471    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416476    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416481    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416488    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416495    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416501    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416507    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416512    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.420800 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416517    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416521    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416526    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416531    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416536    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416541    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416545    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416550    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416557    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416561    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416567    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416572    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416577    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416581    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416586    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416591    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416596    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416600    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416605    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416609    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.421528 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416614    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416638    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416642    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416647    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416651    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416656    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416660    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416665    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416670    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416674    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416679    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416684    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416689    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416694    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416698    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416703    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416707    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.416712    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417459    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417469    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.422118 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417476    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417481    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417493    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417498    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417503    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417508    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417513    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417517    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417521    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417526    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417530    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417535    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417540    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417545    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417549    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417554    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417558    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417563    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417567    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417573    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.422760 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417578    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417583    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417588    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417592    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417597    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417601    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417606    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417610    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417633    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417638    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417642    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417648    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417652    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417657    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417662    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417667    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417672    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417676    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417680    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417685    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.423294 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417689    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417695    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417699    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417704    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417711    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417718    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417722    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417727    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417732    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417737    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417744    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417750    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417755    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417762    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417768    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417772    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417778    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417782    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417787    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.423909 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417791    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417797    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417801    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417806    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417810    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417814    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417819    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417824    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417828    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417833    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417838    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417843    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417847    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417852    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417857    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417861    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417866    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417871    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417875    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417880    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.424398 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417884    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417889    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417893    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417899    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417910    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417917    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417922    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417927    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417932    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417937    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417943    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417947    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417952    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417957    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417962    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417967    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417972    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.417978    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418099    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418112    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 19:15:06.424940 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418122    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418131    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418140    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418146    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418153    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418161    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418167    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418172    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418179    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418184    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418190    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418195    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418200    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418205    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418210    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418216    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418226    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418231    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418237    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418242    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418248    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418255    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418261    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 19:15:06.425526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418267    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418272    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418277    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418282    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418288    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418294    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418299    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418306    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418312    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418317    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418322    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418328    2576 flags.go:64] FLAG: --enable-server="true"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418334    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418342    2576 flags.go:64] FLAG: --event-burst="100"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418347    2576 flags.go:64] FLAG: --event-qps="50"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418352    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418357    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418363    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418369    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418375    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418380    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418386    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418391    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418396    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418401    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 19:15:06.426224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418406    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418411    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418416    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418422    2576 flags.go:64] FLAG: --feature-gates=""
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418428    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418434    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418439    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418444    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418450    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418455    2576 flags.go:64] FLAG: --help="false"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418460    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418466    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418471    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418477    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418483    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418489    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418494    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418499    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418504    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418509    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418515    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418521    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418529    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418534    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 19:15:06.426919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418539    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418544    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418550    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418555    2576 flags.go:64] FLAG: --lock-file=""
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418560    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418565    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418570    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418580    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418585    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418591    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418596    2576 flags.go:64] FLAG: --logging-format="text"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418602    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418608    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418613    2576 flags.go:64] FLAG: --manifest-url=""
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418634    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418642    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418647    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418654    2576 flags.go:64] FLAG: --max-pods="110"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418660    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418665    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418670    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418675    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418681    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418686    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418691    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 19:15:06.427541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418704    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418709    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418715    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418720    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418726    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418736    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418742    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418748    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418753    2576 flags.go:64] FLAG: --port="10250"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418759    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418764    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02e3f8c363f43d208"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418770    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418775    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418780    2576 flags.go:64] FLAG: --register-node="true"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418786    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418793    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418798    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418804    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418809    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418815    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418821    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418826    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418831    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418836    2576 flags.go:64] FLAG: --runonce="false"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418841    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 19:15:06.428292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418847    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418853    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418858    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418863    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418868    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418874    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418879    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418884    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418890    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418895    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418900    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418906    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418912    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418919    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418929    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418935    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418940    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418948    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418953    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418957    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418962    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418968    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418973    2576 flags.go:64] FLAG: --v="2"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418980    2576 flags.go:64] FLAG: --version="false"
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418987    2576 flags.go:64] FLAG: --vmodule=""
Jul 29 19:15:06.428966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418993    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.418999    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419196    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419204    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419210    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419215    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419219    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419225    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419229    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419234    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419238    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419244    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419248    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419253    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419258    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419263    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419268    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419272    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419277    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419281    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.429673 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419289    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419294    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419298    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419306    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419312    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419317    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419322    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419326    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419331    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419338    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419343    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419348    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419353    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419357    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419362    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419367    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419372    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419376    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419384    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.430230 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419390    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419395    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419401    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419406    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419411    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419416    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419420    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419424    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419429    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419434    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419439    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419443    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419448    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419454    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419460    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419465    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419469    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419476    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419481    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419486    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.431106 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419491    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419495    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419502    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419506    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419511    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419516    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419520    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419525    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419529    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419534    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419538    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419543    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419548    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419552    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419557    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419562    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419566    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419571    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419576    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419580    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.431949 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419584    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419589    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419593    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419598    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419603    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419609    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419614    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419640    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419645    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419649    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419653    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419658    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419663    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419667    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419674    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419679    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419683    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419688    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419692    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419697    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.432498 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419702    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.419706    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.419715    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.427637    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.427658    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.427681    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.427687    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427748    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427754    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427757    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427761    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427764    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427767    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427770    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.433092 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427773    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427776    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427779    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427782    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427785    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427788    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427791    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427796    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427801    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427804    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427807    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427810    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427813    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427817    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427820    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427823    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427833    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427836    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.433480 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427839    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427842    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427845    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427849    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427852    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427856    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427859    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427862    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427865    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427868    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427872    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427876    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427879    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427882    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427885    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427888    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427891    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427895    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427898    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427901    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.433971 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427904    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427907    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427910    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427913    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427916    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427919    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427922    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427924    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427927    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427930    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427932    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427935    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427939    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427941    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427944    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427947    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427951    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427955    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427959    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427962    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.434509 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427965    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427968    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427971    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427973    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427976    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427979    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427981    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427984    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427987    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427989    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427992    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427995    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.427998    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428001    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428004    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428006    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428009    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428012    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428014    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428017    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.435058 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428019    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428022    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428025    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428028    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428031    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428033    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428036    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428039    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428042    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428045    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428047    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428050    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428053    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428056    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.428061    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:15:06.435577 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428185    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428192    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428196    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428200    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428203    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428207    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428210    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428213    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428216    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428219    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428223    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428228    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428231    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428235    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428237    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428240    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428243    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428246    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428248    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:15:06.436104 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428251    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428254    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428257    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428260    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428263    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428266    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428269    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428272    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428275    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428278    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428281    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428284    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428287    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428289    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428292    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428295    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428298    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428301    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428304    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:15:06.436608 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428307    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428310    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428313    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428315    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428318    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428321    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428324    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428327    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428330    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428332    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428335    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428338    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428341    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428344    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428346    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428349    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428352    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428355    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428358    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428361    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:15:06.437112 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428363    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428366    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428369    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428372    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428374    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428377    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428380    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428382    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428385    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428388    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428391    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428393    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428396    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428399    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428402    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428404    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428407    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428410    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428412    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428416    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:15:06.437647 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428418    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428421    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428424    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428427    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428429    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428432    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428435    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428437    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428440    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428443    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428446    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428449    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428451    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428454    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428457    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428459    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428462    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428465    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428468    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428470    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:15:06.438171 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:06.428473    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:15:06.438812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.428478    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:15:06.438812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.428608    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 19:15:06.438812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.433697    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 19:15:06.438812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.435120    2576 server.go:1019] "Starting client certificate rotation"
Jul 29 19:15:06.438812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.435231    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:15:06.438812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.435275    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:15:06.438812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.437952    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:15:06.440429 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.440409    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:15:06.453921 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.453895    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 29 19:15:06.456228 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.456211    2576 log.go:25] "Validated CRI v1 image API"
Jul 29 19:15:06.457181 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.457158    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 19:15:06.461217 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.461190    2576 fs.go:135] Filesystem UUIDs: map[26346493-da27-4f6f-9b28-59bfef7b205b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e3b39268-91b6-4124-94b7-9a5ef1637dbd:/dev/nvme0n1p3]
Jul 29 19:15:06.461266 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.461217    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 19:15:06.467480 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.467346    2576 manager.go:216] Machine: {Timestamp:2026-07-29 19:15:06.465946697 +0000 UTC m=+0.361763960 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099665 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e2e03f01d82a669b9159a73c963a SystemUUID:ec25e2e0-3f01-d82a-669b-9159a73c963a BootID:658dc887-2bf3-44f8-af33-59a181979d3d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dc:64:ea:43:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dc:64:ea:43:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:f0:9d:a5:4c:d2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 19:15:06.467480 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.467474    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 19:15:06.467602 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.467572    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 19:15:06.468655 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.468613    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 19:15:06.468833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.468658    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 19:15:06.469999 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.469987    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 19:15:06.470040 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.470002    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 19:15:06.470040 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.470010    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:15:06.470676 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.470665    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:15:06.471495 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.471477    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:15:06.472075 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.472060    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 19:15:06.475132 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475118    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:15:06.475271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475261    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 19:15:06.475308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475296    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 19:15:06.475308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475307    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 19:15:06.475372 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475325    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 19:15:06.475372 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475336    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 29 19:15:06.475372 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475346    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 19:15:06.475727 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.475715    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:15:06.476787 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.476472    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:15:06.479597 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.479573    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 19:15:06.481790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.481773    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 19:15:06.481892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.481814    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 19:15:06.483382 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483366    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483387    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483397    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483404    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483417    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483426    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483439    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483448    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483459    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 19:15:06.483469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483468    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 19:15:06.483775 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483481    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 19:15:06.483775 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.483490    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 19:15:06.484087 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.484075    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 19:15:06.484138 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.484090    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 19:15:06.487552 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.487535    2576 server.go:1268] "Started kubelet"
Jul 29 19:15:06.487726 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.487616    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 19:15:06.487726 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.487714    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 19:15:06.487887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.487747    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 19:15:06.488530 ip-10-0-131-202 systemd[1]: Started Kubernetes Kubelet.
Jul 29 19:15:06.488982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.488960    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 19:15:06.489818 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.489804    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 19:15:06.491437 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.491408    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 19:15:06.491437 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.491415    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 19:15:06.491591 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.491434    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 19:15:06.495482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.495460    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 19:15:06.497192 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.497170    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 19:15:06.497297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.497191    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 19:15:06.497362 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.497350    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:06.498010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.497976    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 19:15:06.498111 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498020    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 19:15:06.498111 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498033    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 19:15:06.498212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498164    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 19:15:06.498212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498176    2576 factory.go:55] Registering systemd factory
Jul 29 19:15:06.498212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498184    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 29 19:15:06.498212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498190    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 19:15:06.498212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498202    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 19:15:06.498466 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498434    2576 factory.go:153] Registering CRI-O factory
Jul 29 19:15:06.498466 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498448    2576 factory.go:223] Registration of the crio container factory successfully
Jul 29 19:15:06.498466 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498469    2576 factory.go:103] Registering Raw factory
Jul 29 19:15:06.498583 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.498481    2576 manager.go:1196] Started watching for new ooms in manager
Jul 29 19:15:06.499028 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.499004    2576 manager.go:349] Starting recovery of all containers
Jul 29 19:15:06.500067 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.498872    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-202.ec2.internal.18c6d8a53c0a860b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-202.ec2.internal,UID:ip-10-0-131-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-202.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.487506443 +0000 UTC m=+0.383323706,LastTimestamp:2026-07-29 19:15:06.487506443 +0000 UTC m=+0.383323706,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-202.ec2.internal,}"
Jul 29 19:15:06.503087 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.503058    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 19:15:06.507740 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.502922    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 19:15:06.512598 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.512578    2576 manager.go:354] Recovery completed
Jul 29 19:15:06.517112 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.517100    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.519649 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.519623    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.519732 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.519667    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.519732 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.519683    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.520254 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.520239    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 19:15:06.520254 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.520251    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 19:15:06.520361 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.520269    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:15:06.520361 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.520242    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.521145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.521127    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.521220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.521162    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.521220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.521177    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.521888 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.521817    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-202.ec2.internal.18c6d8a53df4f590  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-202.ec2.internal,UID:ip-10-0-131-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-202.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.519647632 +0000 UTC m=+0.415464904,LastTimestamp:2026-07-29 19:15:06.519647632 +0000 UTC m=+0.415464904,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-202.ec2.internal,}"
Jul 29 19:15:06.522208 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.522196    2576 policy_none.go:49] "None policy: Start"
Jul 29 19:15:06.522246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.522219    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 19:15:06.522246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.522230    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 19:15:06.523514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.523503    2576 policy_none.go:47] "Start"
Jul 29 19:15:06.532294 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.532113    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-202.ec2.internal.18c6d8a53df563ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-202.ec2.internal,UID:ip-10-0-131-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-202.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-202.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.519675854 +0000 UTC m=+0.415493116,LastTimestamp:2026-07-29 19:15:06.519675854 +0000 UTC m=+0.415493116,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-202.ec2.internal,}"
Jul 29 19:15:06.543036 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.543009    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xcp8l"
Jul 29 19:15:06.545884 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.545807    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-202.ec2.internal.18c6d8a53df591f4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-202.ec2.internal,UID:ip-10-0-131-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-202.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-202.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.519687668 +0000 UTC m=+0.415504931,LastTimestamp:2026-07-29 19:15:06.519687668 +0000 UTC m=+0.415504931,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-202.ec2.internal,}"
Jul 29 19:15:06.550562 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.550542    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xcp8l"
Jul 29 19:15:06.556281 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.556200    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-202.ec2.internal.18c6d8a53df4f590\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-202.ec2.internal.18c6d8a53df4f590  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-202.ec2.internal,UID:ip-10-0-131-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-202.ec2.internal,},FirstTimestamp:2026-07-29 19:15:06.519647632 +0000 UTC m=+0.415464904,LastTimestamp:2026-07-29 19:15:06.521145575 +0000 UTC m=+0.416962842,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-202.ec2.internal,}"
Jul 29 19:15:06.558464 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.558447    2576 manager.go:337] "Starting Device Plugin manager"
Jul 29 19:15:06.558541 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.558494    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 19:15:06.558541 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.558508    2576 server.go:87] "Starting device plugin registration server"
Jul 29 19:15:06.558848 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.558834    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 19:15:06.558889 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.558850    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 19:15:06.558979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.558956    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 19:15:06.559073 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.559055    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 19:15:06.559073 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.559071    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 19:15:06.559944 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.559890    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 19:15:06.560012 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.559995    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:06.660612 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.660567    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.661874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.661751    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.661874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.661785    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.661874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.661796    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.661874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.661825    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.671891 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.671869    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.672039 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.671900    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-202.ec2.internal\": node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:06.699456 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.699425    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:06.707258 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.707224    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 19:15:06.708616 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.708599    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 19:15:06.708704 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.708645    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 19:15:06.708761 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.708752    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 19:15:06.708814 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.708802    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 19:15:06.713298 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.713275    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:06.800560 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.800499    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:06.809975 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.809942    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal"]
Jul 29 19:15:06.810049 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.810043    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.812377 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.812355    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.812486 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.812393    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.812486 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.812418    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.814016 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.814003    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.814182 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.814167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.814227 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.814196    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.814958 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.814930    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.815044 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.814981    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.815044 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.814993    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.815111 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.815077    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.815143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.815111    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.815143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.815140    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.816348 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.816329    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.816452 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.816369    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:15:06.817235 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.817219    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:15:06.817314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.817271    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:15:06.817314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.817285    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:15:06.830300 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.830273    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-202.ec2.internal\" not found" node="ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.834028 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.834011    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-202.ec2.internal\" not found" node="ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.900852 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:06.900818    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:06.900974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.900875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89f86f938532cea461d376c540ae1a20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal\" (UID: \"89f86f938532cea461d376c540ae1a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.900974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.900900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f86f938532cea461d376c540ae1a20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal\" (UID: \"89f86f938532cea461d376c540ae1a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:06.900974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:06.900920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b997b5b4f9231c7f1b31583b88bf7d6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-202.ec2.internal\" (UID: \"1b997b5b4f9231c7f1b31583b88bf7d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.001731 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:07.001660    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:07.001731 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.001692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f86f938532cea461d376c540ae1a20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal\" (UID: \"89f86f938532cea461d376c540ae1a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.001731 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.001727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b997b5b4f9231c7f1b31583b88bf7d6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-202.ec2.internal\" (UID: \"1b997b5b4f9231c7f1b31583b88bf7d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.001864 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.001745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89f86f938532cea461d376c540ae1a20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal\" (UID: \"89f86f938532cea461d376c540ae1a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.001864 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.001820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b997b5b4f9231c7f1b31583b88bf7d6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-202.ec2.internal\" (UID: \"1b997b5b4f9231c7f1b31583b88bf7d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.001864 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.001854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89f86f938532cea461d376c540ae1a20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal\" (UID: \"89f86f938532cea461d376c540ae1a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.001958 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.001820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f86f938532cea461d376c540ae1a20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal\" (UID: \"89f86f938532cea461d376c540ae1a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.102254 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:07.102210    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:07.133784 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.133759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.138395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.138207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.203076 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:07.203031    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:07.303445 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:07.303361    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:07.403529 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:07.403480    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:07.435598 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.435568    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 19:15:07.436052 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.435760    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 19:15:07.504095 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:07.504062    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-202.ec2.internal\" not found"
Jul 29 19:15:07.552624 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.552594    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:07.555771 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.555711    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 19:10:07 +0000 UTC" deadline="2028-01-08 01:55:41.032370959 +0000 UTC"
Jul 29 19:15:07.555771 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.555741    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12654h40m33.476633323s"
Jul 29 19:15:07.598357 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.598298    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.614181 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.614149    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:15:07.616511 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.616488    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal"
Jul 29 19:15:07.628967 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.628941    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:15:07.753273 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.753245    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:07.808765 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:07.808688    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b997b5b4f9231c7f1b31583b88bf7d6.slice/crio-22e835acd03e837f399555ef98915d124d5bec20f068ee79e4aa286ee2449d51 WatchSource:0}: Error finding container 22e835acd03e837f399555ef98915d124d5bec20f068ee79e4aa286ee2449d51: Status 404 returned error can't find the container with id 22e835acd03e837f399555ef98915d124d5bec20f068ee79e4aa286ee2449d51
Jul 29 19:15:07.814330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:07.814307    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:15:07.905275 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:07.905242    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f86f938532cea461d376c540ae1a20.slice/crio-e14c2bbc39ab74cfb520c3c28d520a181e462b0706587f6cffe83b28a267ba32 WatchSource:0}: Error finding container e14c2bbc39ab74cfb520c3c28d520a181e462b0706587f6cffe83b28a267ba32: Status 404 returned error can't find the container with id e14c2bbc39ab74cfb520c3c28d520a181e462b0706587f6cffe83b28a267ba32
Jul 29 19:15:08.085045 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.084960    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:08.479999 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.479907    2576 apiserver.go:52] "Watching apiserver"
Jul 29 19:15:08.488179 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.488153    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 19:15:08.488562 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.488541    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal","openshift-multus/multus-cdzsp","kube-system/konnectivity-agent-gnkr5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th","openshift-multus/multus-additional-cni-plugins-l6xrl","openshift-multus/network-metrics-daemon-bqgqz","openshift-network-diagnostics/network-check-target-756dk","openshift-network-operator/iptables-alerter-4hkts","openshift-ovn-kubernetes/ovnkube-node-8s6vg","kube-system/global-pull-secret-syncer-kklpt","kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9jfsb","openshift-dns/node-resolver-59448","openshift-image-registry/node-ca-xthj6"]
Jul 29 19:15:08.490294 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.490278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:08.490371 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.490351    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:08.491369 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.491355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.492455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.492439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.493717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.493697    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.493930 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.493914    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.493988 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.493950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.494875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.494843    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 19:15:08.495010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.494990    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c5rtv\""
Jul 29 19:15:08.495261 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.495242    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 19:15:08.495466 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.494048    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d26nr\""
Jul 29 19:15:08.496188 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.496166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.497444 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.497024    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.497444 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.497434    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 19:15:08.497628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.497530    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2krxk\""
Jul 29 19:15:08.497785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.497761    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 19:15:08.497890 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.497800    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.498286 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.498268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:08.498388 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.498363    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:08.499074 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.498815    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.499913 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.499886    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 19:15:08.500250 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.500223    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.500409 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.500247    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 19:15:08.500581 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.500543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.500941 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.500828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p96wx\""
Jul 29 19:15:08.502088 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.502072    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 19:15:08.502690 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.502670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.504220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.504198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.505412 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.505394    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 19:15:08.505641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.505444    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 19:15:08.505748 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.505481    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.505748 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.505690    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 19:15:08.505748 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.505693    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.505911 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.505834    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.505965 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.505931    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:08.506022 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.505995    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.506084 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.506050    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 19:15:08.506084 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.506054    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.506180 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.506125    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 19:15:08.506180 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.506131    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8l258\""
Jul 29 19:15:08.506263 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.506197    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gd8v8\""
Jul 29 19:15:08.506548 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.506532    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54ppz\""
Jul 29 19:15:08.506777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.506763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 19:15:08.507164 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.507143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.508539 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.508520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.509929 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.509883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpgxc\" (UniqueName: \"kubernetes.io/projected/60a484a0-1132-4a26-96f6-3d86d734fc01-kube-api-access-mpgxc\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.510024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.509935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px89l\" (UniqueName: \"kubernetes.io/projected/8f310751-a3b2-414d-aa3e-5c886331cdc6-kube-api-access-px89l\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:08.510024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.509998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-node-log\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510136 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-env-overrides\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510136 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-os-release\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.510136 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-slash\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-systemd\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510147    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.510248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-var-lib-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7-konnectivity-ca\") pod \"konnectivity-agent-gnkr5\" (UID: \"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7\") " pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.510248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrttz\" (UniqueName: \"kubernetes.io/projected/150ff82e-5d78-40c2-afc4-3940350d70be-kube-api-access-mrttz\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.510461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.510461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.510461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-systemd-units\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-log-socket\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2xsz\" (UniqueName: \"kubernetes.io/projected/f7d9817f-31df-4c2f-b858-af8312361758-kube-api-access-h2xsz\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-cni-bin\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-socket-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-etc-selinux\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-system-cni-dir\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9351cd-2561-46a6-8474-80f9f6321b66-tmp-dir\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5k7s\" (UniqueName: \"kubernetes.io/projected/3a9351cd-2561-46a6-8474-80f9f6321b66-kube-api-access-q5k7s\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-sys-fs\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:08.510786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-kubelet\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-ovn\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a9351cd-2561-46a6-8474-80f9f6321b66-hosts-file\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7-agent-certs\") pod \"konnectivity-agent-gnkr5\" (UID: \"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7\") " pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.510995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-registration-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-run-netns\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511091    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-etc-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-cni-netd\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-ovnkube-config\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-device-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-cnibin\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511379    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7d9817f-31df-4c2f-b858-af8312361758-ovn-node-metrics-cert\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511411    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-ovnkube-script-lib\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511483    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jrqxl\""
Jul 29 19:15:08.511762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.511530    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gckgz\""
Jul 29 19:15:08.517886 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.517865    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:15:08.558143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.558119    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vjjd7"
Jul 29 19:15:08.570797 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.570775    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vjjd7"
Jul 29 19:15:08.599616 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.599577    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.612670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-slash\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.612727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-systemd\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.612764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-var-lib-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.612784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-slash\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.612800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-host\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.612921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-var-lib-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.612959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7-konnectivity-ca\") pod \"konnectivity-agent-gnkr5\" (UID: \"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7\") " pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrttz\" (UniqueName: \"kubernetes.io/projected/150ff82e-5d78-40c2-afc4-3940350d70be-kube-api-access-mrttz\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-systemd\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-log-socket\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2xsz\" (UniqueName: \"kubernetes.io/projected/f7d9817f-31df-4c2f-b858-af8312361758-kube-api-access-h2xsz\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpd9\" (UniqueName: \"kubernetes.io/projected/ca7ed739-35b6-4cf6-8922-3f631056a7e6-kube-api-access-zqpd9\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-lib-modules\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-socket-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-socket-dir-parent\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.613671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysconfig\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.614114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysctl-d\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.614114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-socket-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.614114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.613984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-log-socket\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.614252 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmz9w\" (UniqueName: \"kubernetes.io/projected/229b4d90-95b1-4cf2-a444-de7c8d483d55-kube-api-access-kmz9w\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.614252 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9351cd-2561-46a6-8474-80f9f6321b66-tmp-dir\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.614341 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-sys-fs\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.614341 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-kubelet\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.614431 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.614431 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-cni-netd\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.614431 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd97036a-5a5b-44cd-826a-0ccfd261f490-serviceca\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.614558 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-k8s-cni-cncf-io\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.614558 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a9351cd-2561-46a6-8474-80f9f6321b66-hosts-file\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.614558 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-registration-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.614558 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-etc-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.614758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-ovnkube-config\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.614758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7d9817f-31df-4c2f-b858-af8312361758-ovn-node-metrics-cert\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.614758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-dbus\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.614758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9351cd-2561-46a6-8474-80f9f6321b66-tmp-dir\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.614758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tms49\" (UniqueName: \"kubernetes.io/projected/fd97036a-5a5b-44cd-826a-0ccfd261f490-kube-api-access-tms49\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.614758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-hostroot\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.614758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-cnibin\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-ovnkube-script-lib\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a9351cd-2561-46a6-8474-80f9f6321b66-hosts-file\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-conf-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-etc-kubernetes\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-sys-fs\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca7ed739-35b6-4cf6-8922-3f631056a7e6-host-slash\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-kubelet\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614950    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-registration-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.614968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-kubernetes\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.615053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-os-release\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpgxc\" (UniqueName: \"kubernetes.io/projected/60a484a0-1132-4a26-96f6-3d86d734fc01-kube-api-access-mpgxc\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px89l\" (UniqueName: \"kubernetes.io/projected/8f310751-a3b2-414d-aa3e-5c886331cdc6-kube-api-access-px89l\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-node-log\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-kubelet\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rthlj\" (UniqueName: \"kubernetes.io/projected/a52d02c4-047b-413d-8c82-c6435ccb4744-kube-api-access-rthlj\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-os-release\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysctl-conf\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-systemd\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.615479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-var-lib-kubelet\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-systemd-units\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-kubelet-config\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-modprobe-d\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-cni-bin\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-ovnkube-config\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-system-cni-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a52d02c4-047b-413d-8c82-c6435ccb4744-cni-binary-copy\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-netns\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-multus-certs\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-sys\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-cni-netd\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-etc-selinux\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.615943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-system-cni-dir\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.616546 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.616546 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.615018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-etc-openvswitch\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.616546 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-cni-bin\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.616546 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-system-cni-dir\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.616546 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-etc-selinux\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.616546 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616324    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-node-log\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.616546 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-systemd-units\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.616855 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616605    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-os-release\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.616855 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.616855 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.616855 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60a484a0-1132-4a26-96f6-3d86d734fc01-cnibin\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.616855 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616721    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 19:15:08.617076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.616990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-tuned\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.617138 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/229b4d90-95b1-4cf2-a444-de7c8d483d55-tmp\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.617186 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5k7s\" (UniqueName: \"kubernetes.io/projected/3a9351cd-2561-46a6-8474-80f9f6321b66-kube-api-access-q5k7s\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.617228 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:08.617308 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.617287    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:08.617362 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:08.617405 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-ovn\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.617448 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.617572 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.617545    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs podName:8f310751-a3b2-414d-aa3e-5c886331cdc6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:09.117510121 +0000 UTC m=+3.013327390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs") pod "network-metrics-daemon-bqgqz" (UID: "8f310751-a3b2-414d-aa3e-5c886331cdc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:08.617572 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617549    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-ovnkube-script-lib\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.617739 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.617739 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-cni-multus\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.617867 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-run\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.617867 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7-konnectivity-ca\") pod \"konnectivity-agent-gnkr5\" (UID: \"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7\") " pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.617963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.617963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-cni-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.617963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617926    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-run-ovn\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.617963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.618202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.617978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7-agent-certs\") pod \"konnectivity-agent-gnkr5\" (UID: \"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7\") " pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.618202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-run-netns\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.618202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd97036a-5a5b-44cd-826a-0ccfd261f490-host\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.618202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7d9817f-31df-4c2f-b858-af8312361758-host-run-netns\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.618202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-cnibin\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.618202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-device-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.618202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.618549 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-env-overrides\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.618549 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/150ff82e-5d78-40c2-afc4-3940350d70be-device-dir\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.618549 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-cni-bin\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.618549 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-daemon-config\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.618783 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ca7ed739-35b6-4cf6-8922-3f631056a7e6-iptables-alerter-script\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.618783 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.618882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.618766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60a484a0-1132-4a26-96f6-3d86d734fc01-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.619104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.619081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7d9817f-31df-4c2f-b858-af8312361758-env-overrides\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.620479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.620458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7d9817f-31df-4c2f-b858-af8312361758-ovn-node-metrics-cert\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.620662 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.620641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7-agent-certs\") pod \"konnectivity-agent-gnkr5\" (UID: \"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7\") " pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.639339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.639305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2xsz\" (UniqueName: \"kubernetes.io/projected/f7d9817f-31df-4c2f-b858-af8312361758-kube-api-access-h2xsz\") pod \"ovnkube-node-8s6vg\" (UID: \"f7d9817f-31df-4c2f-b858-af8312361758\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.642732 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.642713    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:08.642823 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.642740    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:08.642823 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.642753    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jzsp4 for pod openshift-network-diagnostics/network-check-target-756dk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:08.642926 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.642831    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4 podName:e45bf47f-ef8e-403a-8897-eb31f691c9a6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:09.14281203 +0000 UTC m=+3.038629299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jzsp4" (UniqueName: "kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4") pod "network-check-target-756dk" (UID: "e45bf47f-ef8e-403a-8897-eb31f691c9a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:08.644956 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.644924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpgxc\" (UniqueName: \"kubernetes.io/projected/60a484a0-1132-4a26-96f6-3d86d734fc01-kube-api-access-mpgxc\") pod \"multus-additional-cni-plugins-l6xrl\" (UID: \"60a484a0-1132-4a26-96f6-3d86d734fc01\") " pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.645062 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.645019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrttz\" (UniqueName: \"kubernetes.io/projected/150ff82e-5d78-40c2-afc4-3940350d70be-kube-api-access-mrttz\") pod \"aws-ebs-csi-driver-node-v79th\" (UID: \"150ff82e-5d78-40c2-afc4-3940350d70be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.645062 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.645050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px89l\" (UniqueName: \"kubernetes.io/projected/8f310751-a3b2-414d-aa3e-5c886331cdc6-kube-api-access-px89l\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:08.645333 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.645311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5k7s\" (UniqueName: \"kubernetes.io/projected/3a9351cd-2561-46a6-8474-80f9f6321b66-kube-api-access-q5k7s\") pod \"node-resolver-59448\" (UID: \"3a9351cd-2561-46a6-8474-80f9f6321b66\") " pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.713231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.713173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal" event={"ID":"89f86f938532cea461d376c540ae1a20","Type":"ContainerStarted","Data":"e14c2bbc39ab74cfb520c3c28d520a181e462b0706587f6cffe83b28a267ba32"}
Jul 29 19:15:08.714330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.714304    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal" event={"ID":"1b997b5b4f9231c7f1b31583b88bf7d6","Type":"ContainerStarted","Data":"22e835acd03e837f399555ef98915d124d5bec20f068ee79e4aa286ee2449d51"}
Jul 29 19:15:08.719238 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-host\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpd9\" (UniqueName: \"kubernetes.io/projected/ca7ed739-35b6-4cf6-8922-3f631056a7e6-kube-api-access-zqpd9\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.719316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-lib-modules\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-socket-dir-parent\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-socket-dir-parent\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-host\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysconfig\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysctl-d\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-lib-modules\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmz9w\" (UniqueName: \"kubernetes.io/projected/229b4d90-95b1-4cf2-a444-de7c8d483d55-kube-api-access-kmz9w\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd97036a-5a5b-44cd-826a-0ccfd261f490-serviceca\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysconfig\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysctl-d\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-k8s-cni-cncf-io\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-dbus\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tms49\" (UniqueName: \"kubernetes.io/projected/fd97036a-5a5b-44cd-826a-0ccfd261f490-kube-api-access-tms49\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-k8s-cni-cncf-io\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-hostroot\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-conf-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-etc-kubernetes\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-hostroot\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca7ed739-35b6-4cf6-8922-3f631056a7e6-host-slash\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-etc-kubernetes\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-dbus\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.719790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719797    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca7ed739-35b6-4cf6-8922-3f631056a7e6-host-slash\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-conf-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-kubernetes\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-os-release\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-kubelet\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rthlj\" (UniqueName: \"kubernetes.io/projected/a52d02c4-047b-413d-8c82-c6435ccb4744-kube-api-access-rthlj\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719948    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-kubernetes\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysctl-conf\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-os-release\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd97036a-5a5b-44cd-826a-0ccfd261f490-serviceca\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-kubelet\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.719999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-systemd\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-var-lib-kubelet\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-systemd\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720059    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-sysctl-conf\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-kubelet-config\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-modprobe-d\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-kubelet-config\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.720467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-var-lib-kubelet\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-system-cni-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-modprobe-d\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a52d02c4-047b-413d-8c82-c6435ccb4744-cni-binary-copy\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-netns\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-system-cni-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-multus-certs\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-sys\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-tuned\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/229b4d90-95b1-4cf2-a444-de7c8d483d55-tmp\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720262    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-netns\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-sys\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-run-multus-certs\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-cni-multus\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-run\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-cni-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd97036a-5a5b-44cd-826a-0ccfd261f490-host\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.721194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-cni-multus\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-cnibin\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.720527    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720585    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd97036a-5a5b-44cd-826a-0ccfd261f490-host\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-cni-dir\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:08.720626    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret podName:27ed65c4-fe8d-4a3d-986b-8fb9986e86db nodeName:}" failed. No retries permitted until 2026-07-29 19:15:09.220587569 +0000 UTC m=+3.116404827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret") pod "global-pull-secret-syncer-kklpt" (UID: "27ed65c4-fe8d-4a3d-986b-8fb9986e86db") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-cnibin\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-cni-bin\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a52d02c4-047b-413d-8c82-c6435ccb4744-host-var-lib-cni-bin\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a52d02c4-047b-413d-8c82-c6435ccb4744-cni-binary-copy\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/229b4d90-95b1-4cf2-a444-de7c8d483d55-run\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-daemon-config\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.720777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ca7ed739-35b6-4cf6-8922-3f631056a7e6-iptables-alerter-script\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.721094    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a52d02c4-047b-413d-8c82-c6435ccb4744-multus-daemon-config\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.721895 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.721386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ca7ed739-35b6-4cf6-8922-3f631056a7e6-iptables-alerter-script\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.722732 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.722715    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/229b4d90-95b1-4cf2-a444-de7c8d483d55-etc-tuned\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.722868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.722851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/229b4d90-95b1-4cf2-a444-de7c8d483d55-tmp\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.731161 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.731112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpd9\" (UniqueName: \"kubernetes.io/projected/ca7ed739-35b6-4cf6-8922-3f631056a7e6-kube-api-access-zqpd9\") pod \"iptables-alerter-4hkts\" (UID: \"ca7ed739-35b6-4cf6-8922-3f631056a7e6\") " pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.735242 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.735221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tms49\" (UniqueName: \"kubernetes.io/projected/fd97036a-5a5b-44cd-826a-0ccfd261f490-kube-api-access-tms49\") pod \"node-ca-xthj6\" (UID: \"fd97036a-5a5b-44cd-826a-0ccfd261f490\") " pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.739406 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.739385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmz9w\" (UniqueName: \"kubernetes.io/projected/229b4d90-95b1-4cf2-a444-de7c8d483d55-kube-api-access-kmz9w\") pod \"tuned-9jfsb\" (UID: \"229b4d90-95b1-4cf2-a444-de7c8d483d55\") " pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.739531 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.739390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rthlj\" (UniqueName: \"kubernetes.io/projected/a52d02c4-047b-413d-8c82-c6435ccb4744-kube-api-access-rthlj\") pod \"multus-cdzsp\" (UID: \"a52d02c4-047b-413d-8c82-c6435ccb4744\") " pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.803476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.803439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59448"
Jul 29 19:15:08.810333 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.810252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:08.813158 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.813113    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9351cd_2561_46a6_8474_80f9f6321b66.slice/crio-ff2b18bd4097291c5a134e08f6b73d2d41a2f8283b65daaf1ba21d11983993da WatchSource:0}: Error finding container ff2b18bd4097291c5a134e08f6b73d2d41a2f8283b65daaf1ba21d11983993da: Status 404 returned error can't find the container with id ff2b18bd4097291c5a134e08f6b73d2d41a2f8283b65daaf1ba21d11983993da
Jul 29 19:15:08.817835 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.817814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th"
Jul 29 19:15:08.818026 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.818002    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6d0fd0_fab0_4849_b7cc_7f1ad0a1b7c7.slice/crio-4ed29dbfb86528129d017a907f8c683eebf01dd11286c6f100621a883b5f7912 WatchSource:0}: Error finding container 4ed29dbfb86528129d017a907f8c683eebf01dd11286c6f100621a883b5f7912: Status 404 returned error can't find the container with id 4ed29dbfb86528129d017a907f8c683eebf01dd11286c6f100621a883b5f7912
Jul 29 19:15:08.823008 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.822983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l6xrl"
Jul 29 19:15:08.827021 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.826994    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150ff82e_5d78_40c2_afc4_3940350d70be.slice/crio-2aff1d490af4eb1674833ce9c4a13be54eb7efaafceca9ec992dfccec86e602a WatchSource:0}: Error finding container 2aff1d490af4eb1674833ce9c4a13be54eb7efaafceca9ec992dfccec86e602a: Status 404 returned error can't find the container with id 2aff1d490af4eb1674833ce9c4a13be54eb7efaafceca9ec992dfccec86e602a
Jul 29 19:15:08.829016 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.828980    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:08.831597 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.831560    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a484a0_1132_4a26_96f6_3d86d734fc01.slice/crio-477591e5efd279fe00e6d85eb3d6da834b295eefd2859e2c070c051f76cb2c73 WatchSource:0}: Error finding container 477591e5efd279fe00e6d85eb3d6da834b295eefd2859e2c070c051f76cb2c73: Status 404 returned error can't find the container with id 477591e5efd279fe00e6d85eb3d6da834b295eefd2859e2c070c051f76cb2c73
Jul 29 19:15:08.835286 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.835200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xthj6"
Jul 29 19:15:08.837479 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.837455    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d9817f_31df_4c2f_b858_af8312361758.slice/crio-d49d17559ce69148aada8d3122bc3092b82361653346047955e790b20880661d WatchSource:0}: Error finding container d49d17559ce69148aada8d3122bc3092b82361653346047955e790b20880661d: Status 404 returned error can't find the container with id d49d17559ce69148aada8d3122bc3092b82361653346047955e790b20880661d
Jul 29 19:15:08.840414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.840394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdzsp"
Jul 29 19:15:08.844287 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.844252    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd97036a_5a5b_44cd_826a_0ccfd261f490.slice/crio-8b9ceb8037abd46f1ded37af013e3a040bf8a8ee1f6105e1a8da0a11f9cce8dc WatchSource:0}: Error finding container 8b9ceb8037abd46f1ded37af013e3a040bf8a8ee1f6105e1a8da0a11f9cce8dc: Status 404 returned error can't find the container with id 8b9ceb8037abd46f1ded37af013e3a040bf8a8ee1f6105e1a8da0a11f9cce8dc
Jul 29 19:15:08.847061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.846894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4hkts"
Jul 29 19:15:08.851868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:08.851852    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jfsb"
Jul 29 19:15:08.858288 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.858266    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7ed739_35b6_4cf6_8922_3f631056a7e6.slice/crio-4d2de458a57ad2998bbc621a23d056e8f91f9c05634d32a645a8718e57630176 WatchSource:0}: Error finding container 4d2de458a57ad2998bbc621a23d056e8f91f9c05634d32a645a8718e57630176: Status 404 returned error can't find the container with id 4d2de458a57ad2998bbc621a23d056e8f91f9c05634d32a645a8718e57630176
Jul 29 19:15:08.860443 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:08.860419    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229b4d90_95b1_4cf2_a444_de7c8d483d55.slice/crio-94cfb8c3749a3f225ace767e547b5d719838c75e1881c01d4f8e9f384f2e67f0 WatchSource:0}: Error finding container 94cfb8c3749a3f225ace767e547b5d719838c75e1881c01d4f8e9f384f2e67f0: Status 404 returned error can't find the container with id 94cfb8c3749a3f225ace767e547b5d719838c75e1881c01d4f8e9f384f2e67f0
Jul 29 19:15:09.023747 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.023620    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:15:09.123383 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.123335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:09.123607 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.123495    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:09.123607 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.123575    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs podName:8f310751-a3b2-414d-aa3e-5c886331cdc6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:10.123544561 +0000 UTC m=+4.019361814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs") pod "network-metrics-daemon-bqgqz" (UID: "8f310751-a3b2-414d-aa3e-5c886331cdc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:09.223838 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.223799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:09.224080 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.223850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:09.224080 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.224001    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:09.224080 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.224070    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret podName:27ed65c4-fe8d-4a3d-986b-8fb9986e86db nodeName:}" failed. No retries permitted until 2026-07-29 19:15:10.224051043 +0000 UTC m=+4.119868299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret") pod "global-pull-secret-syncer-kklpt" (UID: "27ed65c4-fe8d-4a3d-986b-8fb9986e86db") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:09.224249 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.224113    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:09.224249 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.224144    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:09.224249 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.224159    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jzsp4 for pod openshift-network-diagnostics/network-check-target-756dk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:09.224249 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.224220    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4 podName:e45bf47f-ef8e-403a-8897-eb31f691c9a6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:10.224201445 +0000 UTC m=+4.120018695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzsp4" (UniqueName: "kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4") pod "network-check-target-756dk" (UID: "e45bf47f-ef8e-403a-8897-eb31f691c9a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:09.573100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.573030    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:10:08 +0000 UTC" deadline="2028-02-12 20:35:56.48612543 +0000 UTC"
Jul 29 19:15:09.573100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.573098    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13513h20m46.913032097s"
Jul 29 19:15:09.709070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.709035    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:09.709256 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:09.709180    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:09.719171 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.719130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th" event={"ID":"150ff82e-5d78-40c2-afc4-3940350d70be","Type":"ContainerStarted","Data":"2aff1d490af4eb1674833ce9c4a13be54eb7efaafceca9ec992dfccec86e602a"}
Jul 29 19:15:09.721063 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.721030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jfsb" event={"ID":"229b4d90-95b1-4cf2-a444-de7c8d483d55","Type":"ContainerStarted","Data":"94cfb8c3749a3f225ace767e547b5d719838c75e1881c01d4f8e9f384f2e67f0"}
Jul 29 19:15:09.724174 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.724117    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4hkts" event={"ID":"ca7ed739-35b6-4cf6-8922-3f631056a7e6","Type":"ContainerStarted","Data":"4d2de458a57ad2998bbc621a23d056e8f91f9c05634d32a645a8718e57630176"}
Jul 29 19:15:09.728098 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.728068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdzsp" event={"ID":"a52d02c4-047b-413d-8c82-c6435ccb4744","Type":"ContainerStarted","Data":"39d9fc30ae1a600cc0a8598c9f0088da82cb4798e903c06f6006e725987f1602"}
Jul 29 19:15:09.731000 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.730187    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xthj6" event={"ID":"fd97036a-5a5b-44cd-826a-0ccfd261f490","Type":"ContainerStarted","Data":"8b9ceb8037abd46f1ded37af013e3a040bf8a8ee1f6105e1a8da0a11f9cce8dc"}
Jul 29 19:15:09.732136 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.732107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnkr5" event={"ID":"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7","Type":"ContainerStarted","Data":"4ed29dbfb86528129d017a907f8c683eebf01dd11286c6f100621a883b5f7912"}
Jul 29 19:15:09.734306 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.734282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59448" event={"ID":"3a9351cd-2561-46a6-8474-80f9f6321b66","Type":"ContainerStarted","Data":"ff2b18bd4097291c5a134e08f6b73d2d41a2f8283b65daaf1ba21d11983993da"}
Jul 29 19:15:09.736932 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.736908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"d49d17559ce69148aada8d3122bc3092b82361653346047955e790b20880661d"}
Jul 29 19:15:09.739537 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:09.739512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerStarted","Data":"477591e5efd279fe00e6d85eb3d6da834b295eefd2859e2c070c051f76cb2c73"}
Jul 29 19:15:10.132576 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:10.132518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:10.132772 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.132738    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:10.132846 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.132811    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs podName:8f310751-a3b2-414d-aa3e-5c886331cdc6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:12.132790825 +0000 UTC m=+6.028608082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs") pod "network-metrics-daemon-bqgqz" (UID: "8f310751-a3b2-414d-aa3e-5c886331cdc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:10.233952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:10.233864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:10.233952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:10.233918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:10.234186 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.234064    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:10.234186 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.234129    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret podName:27ed65c4-fe8d-4a3d-986b-8fb9986e86db nodeName:}" failed. No retries permitted until 2026-07-29 19:15:12.234110793 +0000 UTC m=+6.129928044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret") pod "global-pull-secret-syncer-kklpt" (UID: "27ed65c4-fe8d-4a3d-986b-8fb9986e86db") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:10.234749 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.234653    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:10.234749 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.234682    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:10.234749 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.234697    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jzsp4 for pod openshift-network-diagnostics/network-check-target-756dk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:10.234749 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.234749    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4 podName:e45bf47f-ef8e-403a-8897-eb31f691c9a6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:12.234732155 +0000 UTC m=+6.130549419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzsp4" (UniqueName: "kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4") pod "network-check-target-756dk" (UID: "e45bf47f-ef8e-403a-8897-eb31f691c9a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:10.573828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:10.573678    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:10:08 +0000 UTC" deadline="2027-12-24 03:40:16.659581374 +0000 UTC"
Jul 29 19:15:10.573828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:10.573723    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12296h25m6.085864834s"
Jul 29 19:15:10.716468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:10.715679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:10.716468 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.715814    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:10.716468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:10.716235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:10.716468 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:10.716354    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:11.709858 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:11.709302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:11.709858 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:11.709444    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:12.153817 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:12.153090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:12.153817 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.153303    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:12.153817 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.153375    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs podName:8f310751-a3b2-414d-aa3e-5c886331cdc6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:16.153355231 +0000 UTC m=+10.049172485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs") pod "network-metrics-daemon-bqgqz" (UID: "8f310751-a3b2-414d-aa3e-5c886331cdc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:12.253588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:12.253647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.253856    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.253925    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret podName:27ed65c4-fe8d-4a3d-986b-8fb9986e86db nodeName:}" failed. No retries permitted until 2026-07-29 19:15:16.253905673 +0000 UTC m=+10.149722923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret") pod "global-pull-secret-syncer-kklpt" (UID: "27ed65c4-fe8d-4a3d-986b-8fb9986e86db") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.254028    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.254048    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.254064    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jzsp4 for pod openshift-network-diagnostics/network-check-target-756dk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:12.254482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.254105    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4 podName:e45bf47f-ef8e-403a-8897-eb31f691c9a6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:16.254091968 +0000 UTC m=+10.149909220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzsp4" (UniqueName: "kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4") pod "network-check-target-756dk" (UID: "e45bf47f-ef8e-403a-8897-eb31f691c9a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:12.710845 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:12.710774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:12.711351 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.710946    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:12.711351 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:12.711331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:12.711479 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:12.711431    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:13.709802 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:13.709771    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:13.709975 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:13.709911    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:14.710502 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:14.710054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:14.710502 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:14.710214    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:14.711275 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:14.711091    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:14.711275 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:14.711208    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:15.709136 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:15.709096    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:15.709320 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:15.709246    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:16.188104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:16.188062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:16.188578 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.188235    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:16.188578 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.188299    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs podName:8f310751-a3b2-414d-aa3e-5c886331cdc6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:24.188280113 +0000 UTC m=+18.084097381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs") pod "network-metrics-daemon-bqgqz" (UID: "8f310751-a3b2-414d-aa3e-5c886331cdc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:16.289057 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:16.289018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:16.289224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:16.289070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:16.289224 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.289189    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:16.289224 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.289193    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:16.289224 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.289221    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:16.289442 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.289236    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jzsp4 for pod openshift-network-diagnostics/network-check-target-756dk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:16.289442 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.289251    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret podName:27ed65c4-fe8d-4a3d-986b-8fb9986e86db nodeName:}" failed. No retries permitted until 2026-07-29 19:15:24.289232965 +0000 UTC m=+18.185050220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret") pod "global-pull-secret-syncer-kklpt" (UID: "27ed65c4-fe8d-4a3d-986b-8fb9986e86db") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:16.289442 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.289287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4 podName:e45bf47f-ef8e-403a-8897-eb31f691c9a6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:24.289272541 +0000 UTC m=+18.185089810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzsp4" (UniqueName: "kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4") pod "network-check-target-756dk" (UID: "e45bf47f-ef8e-403a-8897-eb31f691c9a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:16.711324 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:16.710706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:16.711324 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.710834    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:16.711324 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:16.710912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:16.711324 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:16.710987    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:17.709042 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:17.709007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:17.709538 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:17.709139    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:18.709092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:18.709059    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:18.709501 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:18.709183    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:18.709501 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:18.709269    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:18.709501 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:18.709393    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:19.709935 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:19.709891    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:19.710426 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:19.710034    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:20.709820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:20.709741    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:20.709820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:20.709775    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:20.710317 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:20.709884    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:20.710317 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:20.709987    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:21.709294 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:21.709263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:21.709450 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:21.709389    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:22.709554 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:22.709507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:22.709972 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:22.709518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:22.709972 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:22.709661    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:22.709972 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:22.709752    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:23.709449 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:23.709404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:23.709698 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:23.709554    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:24.248833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:24.248792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:24.249096 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.248975    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:24.249096 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.249041    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs podName:8f310751-a3b2-414d-aa3e-5c886331cdc6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:40.249021428 +0000 UTC m=+34.144838680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs") pod "network-metrics-daemon-bqgqz" (UID: "8f310751-a3b2-414d-aa3e-5c886331cdc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:24.349749 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:24.349710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:24.349749 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:24.349757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:24.349992 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.349860    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:24.349992 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.349878    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:24.349992 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.349885    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:24.349992 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.349900    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jzsp4 for pod openshift-network-diagnostics/network-check-target-756dk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:24.349992 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.349948    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret podName:27ed65c4-fe8d-4a3d-986b-8fb9986e86db nodeName:}" failed. No retries permitted until 2026-07-29 19:15:40.34992842 +0000 UTC m=+34.245745684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret") pod "global-pull-secret-syncer-kklpt" (UID: "27ed65c4-fe8d-4a3d-986b-8fb9986e86db") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:24.349992 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.349964    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4 podName:e45bf47f-ef8e-403a-8897-eb31f691c9a6 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:40.349957347 +0000 UTC m=+34.245774595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzsp4" (UniqueName: "kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4") pod "network-check-target-756dk" (UID: "e45bf47f-ef8e-403a-8897-eb31f691c9a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:24.709733 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:24.709696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:24.709733 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:24.709720    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:24.710262 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.709827    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:24.710262 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:24.710012    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:25.709203 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:25.709176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:25.709375 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:25.709288    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:26.710380 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:26.710348    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:26.710865 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:26.710439    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:26.710865 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:26.710491    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:26.710865 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:26.710618    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:27.709820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:27.709785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:27.709997 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:27.709927    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:28.709825 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.709645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:28.710506 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.709695    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:28.710506 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:28.709956    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:28.710506 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:28.709983    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:28.790482 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.790443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdzsp" event={"ID":"a52d02c4-047b-413d-8c82-c6435ccb4744","Type":"ContainerStarted","Data":"6c99717dc31cea82b76dff020341bfa72e8d9d85c8e70aa41752e300fbdb0fd9"}
Jul 29 19:15:28.794974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.794927    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xthj6" event={"ID":"fd97036a-5a5b-44cd-826a-0ccfd261f490","Type":"ContainerStarted","Data":"f9a64d5e7868d7b64228f69b6edb23b31590ac8f09ebebde8775a8c46e0c1500"}
Jul 29 19:15:28.798565 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.798524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnkr5" event={"ID":"1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7","Type":"ContainerStarted","Data":"dd04f144e47a76fc3a128d7b6aee2112e8482ee71137c32190795d00514e85f9"}
Jul 29 19:15:28.800015 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.799992    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59448" event={"ID":"3a9351cd-2561-46a6-8474-80f9f6321b66","Type":"ContainerStarted","Data":"7cb1a772b4456ecb029f34123a205cfeb1aec6bd23e9f4b018ad08eee983f551"}
Jul 29 19:15:28.801553 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.801520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"5002f027fa075a82a75106cea6a2eb46a99b4a089608c1fc66c007119c70a883"}
Jul 29 19:15:28.801653 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.801590    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"eede2b0e77e775dce0dffcf8ba538666d6a3d833ba789679cdb6416c392af96b"}
Jul 29 19:15:28.802850 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.802827    2576 generic.go:356] "Generic (PLEG): container finished" podID="60a484a0-1132-4a26-96f6-3d86d734fc01" containerID="ed9500e01d99aa01abf9704d6db0203729efdca1bb400df5b947024bcec7e89f" exitCode=0
Jul 29 19:15:28.802905 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.802887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerDied","Data":"ed9500e01d99aa01abf9704d6db0203729efdca1bb400df5b947024bcec7e89f"}
Jul 29 19:15:28.804250 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.804196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th" event={"ID":"150ff82e-5d78-40c2-afc4-3940350d70be","Type":"ContainerStarted","Data":"6d12cdbb886b15ffe8c226e0c3274452458eea468cf62be446f51779da771cfc"}
Jul 29 19:15:28.805637 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.805617    2576 generic.go:356] "Generic (PLEG): container finished" podID="89f86f938532cea461d376c540ae1a20" containerID="96032697c1824accc61f59c6b66fb4f5a0b81025a16d0c092eac0ed88286e7c6" exitCode=0
Jul 29 19:15:28.805722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.805698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal" event={"ID":"89f86f938532cea461d376c540ae1a20","Type":"ContainerDied","Data":"96032697c1824accc61f59c6b66fb4f5a0b81025a16d0c092eac0ed88286e7c6"}
Jul 29 19:15:28.807104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.807075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal" event={"ID":"1b997b5b4f9231c7f1b31583b88bf7d6","Type":"ContainerStarted","Data":"f5cc55969e001bd1be40da6d2730fb466834653c32f0cad342431e3d00446f96"}
Jul 29 19:15:28.808439 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.808418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jfsb" event={"ID":"229b4d90-95b1-4cf2-a444-de7c8d483d55","Type":"ContainerStarted","Data":"5bb8681a3f5977285fde4bc709b90a0649a4141eb11ae1f903d1f8c5e9db3e45"}
Jul 29 19:15:28.813789 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.813743    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cdzsp" podStartSLOduration=2.324427761 podStartE2EDuration="21.813731255s" totalImagesPullingTime="19.489303494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.813023485 +0000 UTC m=+22.708840753" watchObservedRunningTime="2026-07-29 19:15:28.813731255 +0000 UTC m=+22.709548524"
Jul 29 19:15:28.864331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.864285    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gnkr5" podStartSLOduration=2.402199879 podStartE2EDuration="21.864270157s" totalImagesPullingTime="19.462070278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.833160123 +0000 UTC m=+22.728977392" watchObservedRunningTime="2026-07-29 19:15:28.864270157 +0000 UTC m=+22.760087424"
Jul 29 19:15:28.909350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.909169    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9jfsb" podStartSLOduration=2.474291466 podStartE2EDuration="21.909152794s" totalImagesPullingTime="19.434861328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.885883192 +0000 UTC m=+22.781700462" watchObservedRunningTime="2026-07-29 19:15:28.909152794 +0000 UTC m=+22.804970062"
Jul 29 19:15:28.936933 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.936810    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-202.ec2.internal" podStartSLOduration=20.936790564 podStartE2EDuration="20.936790564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.936693868 +0000 UTC m=+22.832511138" watchObservedRunningTime="2026-07-29 19:15:28.936790564 +0000 UTC m=+22.832607832"
Jul 29 19:15:28.950218 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.950181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:28.968683 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.968635    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-59448" podStartSLOduration=2.50180866 podStartE2EDuration="21.968618713s" totalImagesPullingTime="19.466810053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.952360348 +0000 UTC m=+22.848177616" watchObservedRunningTime="2026-07-29 19:15:28.968618713 +0000 UTC m=+22.864435980"
Jul 29 19:15:28.968854 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:28.968701    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xthj6" podStartSLOduration=2.53304403 podStartE2EDuration="21.96869668s" totalImagesPullingTime="19.43565265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:28.968210462 +0000 UTC m=+22.864027743" watchObservedRunningTime="2026-07-29 19:15:28.96869668 +0000 UTC m=+22.864513948"
Jul 29 19:15:29.055034 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.055013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:29.165171 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.165144    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:29.266141 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.266114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:29.412654 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.412576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:29.709308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.709231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:29.709469 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:29.709358    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:29.762155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.762074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:29.813224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.813184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal" event={"ID":"89f86f938532cea461d376c540ae1a20","Type":"ContainerStarted","Data":"6797c2a827c2d2f96faefa4c764b00ae8246c96e4a04716cdd09c7341727eca5"}
Jul 29 19:15:29.814903 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.814864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4hkts" event={"ID":"ca7ed739-35b6-4cf6-8922-3f631056a7e6","Type":"ContainerStarted","Data":"78b8f5027f39202263b2ef6e244f517acd5f0b8dd48c08d2eaf64143b2e8636f"}
Jul 29 19:15:29.818417 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.818389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"174957a12eca16c3f70e2c4298cff00b3493fb265cdfadd0c60f96913d8db25c"}
Jul 29 19:15:29.818524 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.818463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"91d1e77737a2c2edcd460af32089c160b66377af5c84b2ae3320e97f681050b2"}
Jul 29 19:15:29.818524 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.818516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"8461a3a75705a98c0ea168e129a04d8f1a010efbf4e3b724950d8a61a7e2d100"}
Jul 29 19:15:29.818627 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.818581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"c130ec5e1d57e64ae03d3d5b4d999b78b86f3c6f1631b9e42e4ff41412ae1c10"}
Jul 29 19:15:29.833024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.832964    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-202.ec2.internal" podStartSLOduration=21.832944582 podStartE2EDuration="21.832944582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:29.831922729 +0000 UTC m=+23.727739997" watchObservedRunningTime="2026-07-29 19:15:29.832944582 +0000 UTC m=+23.728761852"
Jul 29 19:15:29.845194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.845159    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:29.851135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.851093    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4hkts" podStartSLOduration=14.634856315 podStartE2EDuration="22.851078302s" totalImagesPullingTime="8.216221987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:29.850695506 +0000 UTC m=+23.746512776" watchObservedRunningTime="2026-07-29 19:15:29.851078302 +0000 UTC m=+23.746895598"
Jul 29 19:15:29.984156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:29.984080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:30.067084 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.067052    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xthj6_fd97036a-5a5b-44cd-826a-0ccfd261f490/node-ca/0.log"
Jul 29 19:15:30.071584 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.071491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:30.071919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.071901    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:30.090659 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.090628    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:30.302423 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.302394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:30.418184 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.418152    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:30.551451 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.551421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:30.709373 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.709344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:30.709524 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.709344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:30.709524 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:30.709460    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:30.709654 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:30.709605    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:30.757094 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.757067    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 19:15:30.823085 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.823035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th" event={"ID":"150ff82e-5d78-40c2-afc4-3940350d70be","Type":"ContainerStarted","Data":"209b58c77f94c27843dcb5fbd876630ea5cdb698a2c83501f023ee9709f85105"}
Jul 29 19:15:30.823616 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.823539    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:30.824077 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.824021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gnkr5"
Jul 29 19:15:30.923398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:30.923323    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:31.023947 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.023918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:31.127660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.127627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:31.565069 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.565040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:31.571853 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.571768    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T19:15:30.757086661Z","UUID":"5fa82a90-68cd-43de-9360-92949a8b3ece","Handler":null,"Name":"","Endpoint":""}
Jul 29 19:15:31.573365 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.573345    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 19:15:31.573463 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.573385    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 19:15:31.687344 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.687314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:31.709501 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.709470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:31.709697 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:31.709615    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:31.829081 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:31.828989    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"4ac12db2a9727d26d277f851d14d2c09bfdb285af64b8a656d7aeaf1db388188"}
Jul 29 19:15:32.205471 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:32.205379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:32.306523 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:32.306485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:32.709429 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:32.709392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:32.709642 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:32.709392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:32.709642 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:32.709532    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:32.709766 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:32.709634    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:33.566141 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.565704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:33.709377 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.709343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:33.709536 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:33.709450    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:33.835527 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.835495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" event={"ID":"f7d9817f-31df-4c2f-b858-af8312361758","Type":"ContainerStarted","Data":"819f3f4d8eea3dbe153da0324d4498eb89f1a782d3b6911b916ebc5d0c735e78"}
Jul 29 19:15:33.835756 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.835738    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:33.837394 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.837369    2576 generic.go:356] "Generic (PLEG): container finished" podID="60a484a0-1132-4a26-96f6-3d86d734fc01" containerID="6efec6d9d5e16565d4b577332ea14948410b91afceedae08d9ea45b51d9066a3" exitCode=0
Jul 29 19:15:33.837536 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.837446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerDied","Data":"6efec6d9d5e16565d4b577332ea14948410b91afceedae08d9ea45b51d9066a3"}
Jul 29 19:15:33.839593 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.839573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th" event={"ID":"150ff82e-5d78-40c2-afc4-3940350d70be","Type":"ContainerStarted","Data":"5087582f2276e6f7a7accaa25de471317de5847b66a02c1e1ba730b4446dff25"}
Jul 29 19:15:33.851680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.851658    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:33.870321 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.870266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg" podStartSLOduration=7.368815687 podStartE2EDuration="26.870253406s" totalImagesPullingTime="19.501437719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:33.869692763 +0000 UTC m=+27.765510032" watchObservedRunningTime="2026-07-29 19:15:33.870253406 +0000 UTC m=+27.766070674"
Jul 29 19:15:33.889688 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:33.889637    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v79th" podStartSLOduration=2.997758536 podStartE2EDuration="26.889618857s" totalImagesPullingTime="23.891860321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:33.889570224 +0000 UTC m=+27.785387490" watchObservedRunningTime="2026-07-29 19:15:33.889618857 +0000 UTC m=+27.785436125"
Jul 29 19:15:34.419357 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.419330    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:34.709366 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.709331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:34.710199 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:34.709476    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:34.710199 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.709533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:34.710199 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:34.709641    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:34.835501 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.835469    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:34.841885 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.841864    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 29 19:15:34.842424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.842404    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:34.856626 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.856605    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:34.942554 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:34.942510    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:35.041790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:35.041757    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:35.144869 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:35.144828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:35.247757 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:35.247718    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:35.709828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:35.709602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:35.710274 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:35.709858    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:35.845512 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:35.845476    2576 generic.go:356] "Generic (PLEG): container finished" podID="60a484a0-1132-4a26-96f6-3d86d734fc01" containerID="273eb80b7f3947c61406725457e497dc41a7de304e8ab2f3eb62cdbc837389eb" exitCode=0
Jul 29 19:15:35.845684 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:35.845574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerDied","Data":"273eb80b7f3947c61406725457e497dc41a7de304e8ab2f3eb62cdbc837389eb"}
Jul 29 19:15:35.845684 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:35.845674    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 29 19:15:36.027868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:36.027834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:36.628157 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:36.628127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:36.710870 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:36.710836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:36.711269 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:36.710968    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:36.711269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:36.711021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:36.711269 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:36.711132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:36.770685 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:36.770648    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:36.850260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:36.850235    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 29 19:15:37.014185 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.014154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:37.235894 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.235805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:37.297097 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.297061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:15:37.440654 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.440620    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:37.709699 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.709668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:37.709843 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:37.709769    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:37.832674 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.832641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:37.854632 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.854600    2576 generic.go:356] "Generic (PLEG): container finished" podID="60a484a0-1132-4a26-96f6-3d86d734fc01" containerID="40ecbb371dbf4f78e399bf63c4f38524c425a408aeb96d3a8a9a2154389d8741" exitCode=0
Jul 29 19:15:37.854821 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:37.854695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerDied","Data":"40ecbb371dbf4f78e399bf63c4f38524c425a408aeb96d3a8a9a2154389d8741"}
Jul 29 19:15:38.082061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.082023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:38.365920 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.365846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:38.635115 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.635019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:38.709694 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.709659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:38.709874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.709659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:38.709874 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:38.709795    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:38.709993 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:38.709903    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:38.737114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.737073    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:38.855659 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.855615    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:38.951991 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:38.951911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:39.709714 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:39.709677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:39.709916 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:39.709808    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:40.019926 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.019894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:40.116151 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.116122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:40.277601 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.277493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:40.277756 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.277667    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:40.277756 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.277740    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs podName:8f310751-a3b2-414d-aa3e-5c886331cdc6 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.27772312 +0000 UTC m=+66.173540366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs") pod "network-metrics-daemon-bqgqz" (UID: "8f310751-a3b2-414d-aa3e-5c886331cdc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:15:40.378897 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.378860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:40.378897 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.378899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:40.379125 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.378995    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:40.379125 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.379021    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:15:40.379125 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.379043    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:15:40.379125 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.379047    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret podName:27ed65c4-fe8d-4a3d-986b-8fb9986e86db nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.379033879 +0000 UTC m=+66.274851126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret") pod "global-pull-secret-syncer-kklpt" (UID: "27ed65c4-fe8d-4a3d-986b-8fb9986e86db") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:15:40.379125 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.379053    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jzsp4 for pod openshift-network-diagnostics/network-check-target-756dk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:40.379125 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.379096    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4 podName:e45bf47f-ef8e-403a-8897-eb31f691c9a6 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.379079595 +0000 UTC m=+66.274896855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzsp4" (UniqueName: "kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4") pod "network-check-target-756dk" (UID: "e45bf47f-ef8e-403a-8897-eb31f691c9a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:15:40.538977 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.538863    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:40.640752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.640722    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:40.709854 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.709816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:40.710036 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.709816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:40.710036 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.709953    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:40.710155 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:40.710056    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:40.759031 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.758990    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:40.954796 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:40.954713    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:41.082330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:41.082294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:41.432186 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:41.432155    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:41.709323 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:41.709243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:41.709482 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:41.709361    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:42.229102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:42.229069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:42.628391 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:42.628358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:42.709684 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:42.709650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:42.709862 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:42.709754    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:42.709862 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:42.709852    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:42.709990 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:42.709949    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:42.835530 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:42.835494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:42.867826 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:42.867797    2576 generic.go:356] "Generic (PLEG): container finished" podID="60a484a0-1132-4a26-96f6-3d86d734fc01" containerID="6559cd2b198463d8023e9a64138d8203f869ccaeb2d3b7e9c768f64973b307a5" exitCode=0
Jul 29 19:15:42.867958 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:42.867836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerDied","Data":"6559cd2b198463d8023e9a64138d8203f869ccaeb2d3b7e9c768f64973b307a5"}
Jul 29 19:15:43.033834 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:43.033803    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:43.224175 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:43.224097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:43.709128 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:43.709101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:43.709493 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:43.709192    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:43.873336 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:43.873303    2576 generic.go:356] "Generic (PLEG): container finished" podID="60a484a0-1132-4a26-96f6-3d86d734fc01" containerID="a61402ebd82c7a2b6eee743a66de4b5dfd6912b02e3ec88777f1e5cdc7f72cfe" exitCode=0
Jul 29 19:15:43.873482 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:43.873343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerDied","Data":"a61402ebd82c7a2b6eee743a66de4b5dfd6912b02e3ec88777f1e5cdc7f72cfe"}
Jul 29 19:15:44.242383 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:44.242350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:44.432845 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:44.432809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:44.712922 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:44.712897    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:44.713328 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:44.712899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:44.713328 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:44.712996    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:44.713328 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:44.713067    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:44.824806 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:44.824770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:44.878830 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:44.878799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" event={"ID":"60a484a0-1132-4a26-96f6-3d86d734fc01","Type":"ContainerStarted","Data":"b423671d0d430ab82a08f82555f5aa1c6636dbc61cee3c3626fc740e20fc8ee3"}
Jul 29 19:15:44.906038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:44.905987    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l6xrl" podStartSLOduration=11.67563577 podStartE2EDuration="37.905970668s" totalImagesPullingTime="26.230334898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:44.905438135 +0000 UTC m=+38.801255417" watchObservedRunningTime="2026-07-29 19:15:44.905970668 +0000 UTC m=+38.801787954"
Jul 29 19:15:45.022042 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:45.022013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:45.431012 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:45.430928    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:45.709219 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:45.709131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:45.709388 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:45.709255    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:46.684604 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:46.684569    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:46.710467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:46.710436    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:46.710594 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:46.710562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:46.710594 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:46.710580    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:46.710700 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:46.710644    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:47.709405 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:47.709359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:47.709801 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:47.709473    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:47.741681 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:47.741646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:47.843140 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:47.843105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:48.151135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:48.151104    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:48.709945 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:48.709901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:48.709945 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:48.709947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:48.710379 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:48.710033    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:48.710379 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:48.710149    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:49.362520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:49.362486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:49.709998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:49.709929    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:49.710352 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:49.710021    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:50.712688 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:50.712661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:50.713100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:50.712667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:50.713100 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:50.712772    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:50.713100 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:50.712822    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:51.687225 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:51.687186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:51.709156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:51.709123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:51.709327 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:51.709244    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:51.887960 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:51.887920    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:52.026941 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:52.026914    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:52.709887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:52.709847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:52.710078 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:52.709974    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:52.710078 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:52.710027    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:52.710177 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:52.710124    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:53.017490 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:53.017239    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqgqz"]
Jul 29 19:15:53.017914 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:53.017615    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:53.017914 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:53.017751    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:53.023424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:53.023385    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-756dk"]
Jul 29 19:15:53.023594 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:53.023503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:53.023655 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:53.023629    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:53.024205 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:53.024181    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kklpt"]
Jul 29 19:15:53.024304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:53.024297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:53.024436 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:53.024395    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:54.057735 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:54.057704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:54.709148 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:54.709115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:54.709312 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:54.709115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:54.709312 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:54.709234    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:54.709312 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:54.709115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:54.709406 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:54.709287    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:54.709406 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:54.709377    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:55.255281 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:55.255249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:55.331704 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:55.331673    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:56.710018 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.709990    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:56.710627 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.710128    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:56.710627 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:56.710149    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kklpt" podUID="27ed65c4-fe8d-4a3d-986b-8fb9986e86db"
Jul 29 19:15:56.710627 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:56.710178    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-756dk" podUID="e45bf47f-ef8e-403a-8897-eb31f691c9a6"
Jul 29 19:15:56.710627 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.710238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:56.710627 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:15:56.710318    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqgqz" podUID="8f310751-a3b2-414d-aa3e-5c886331cdc6"
Jul 29 19:15:56.756980 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.756937    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:56.836144 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.836117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:56.905757 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.905726    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-202.ec2.internal" event="NodeReady"
Jul 29 19:15:56.905903 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.905853    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 19:15:56.945589 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.945536    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76ff66c997-hmtbf"]
Jul 29 19:15:56.960362 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.960304    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:56.966524 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.966502    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 19:15:56.966874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.966852    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 19:15:56.967422 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.967112    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 19:15:56.967579 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.967563    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82qj5\""
Jul 29 19:15:56.976353 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.976328    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 19:15:56.991926 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:56.991888    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zbbtz"]
Jul 29 19:15:57.001158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41866977-9a3b-472d-9b20-1092eb4f0976-registry-certificates\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.001158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41866977-9a3b-472d-9b20-1092eb4f0976-installation-pull-secrets\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.001324 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41866977-9a3b-472d-9b20-1092eb4f0976-image-registry-private-configuration\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.001324 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-registry-tls\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.001396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-bound-sa-token\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.001396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41866977-9a3b-472d-9b20-1092eb4f0976-ca-trust-extracted\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.001457 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41866977-9a3b-472d-9b20-1092eb4f0976-trusted-ca\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.001457 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.001418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxs74\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-kube-api-access-mxs74\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.008243 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.008228    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76ff66c997-hmtbf"]
Jul 29 19:15:57.008295 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.008255    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6l97r"]
Jul 29 19:15:57.008366 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.008349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.012275 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.012255    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 19:15:57.012413 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.012321    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 19:15:57.012473 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.012448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8c742\""
Jul 29 19:15:57.018487 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.018465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.024088 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.023974    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 19:15:57.024088 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.024075    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 19:15:57.024240 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.024150    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 19:15:57.024332 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.024318    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7r8x\""
Jul 29 19:15:57.024597 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.024580    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 19:15:57.031732 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.031712    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6l97r"]
Jul 29 19:15:57.036610 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.036588    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 19:15:57.036721 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.036700    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zbbtz"]
Jul 29 19:15:57.085562 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.085516    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gmh97"]
Jul 29 19:15:57.090563 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.090527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.097345 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.097325    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ffrr\""
Jul 29 19:15:57.097345 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.097334    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 19:15:57.097504 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.097361    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 19:15:57.102078 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-bound-sa-token\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41866977-9a3b-472d-9b20-1092eb4f0976-ca-trust-extracted\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da689ff5-458d-4265-8b27-d217b252f2e4-cert\") pod \"ingress-canary-zbbtz\" (UID: \"da689ff5-458d-4265-8b27-d217b252f2e4\") " pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.102172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41866977-9a3b-472d-9b20-1092eb4f0976-trusted-ca\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05507663-503c-4ec6-a483-4552ea884eb8-data-volume\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.102172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxs74\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-kube-api-access-mxs74\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05507663-503c-4ec6-a483-4552ea884eb8-crio-socket\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.102374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hbrc\" (UniqueName: \"kubernetes.io/projected/da689ff5-458d-4265-8b27-d217b252f2e4-kube-api-access-8hbrc\") pod \"ingress-canary-zbbtz\" (UID: \"da689ff5-458d-4265-8b27-d217b252f2e4\") " pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.102374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41866977-9a3b-472d-9b20-1092eb4f0976-registry-certificates\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41866977-9a3b-472d-9b20-1092eb4f0976-installation-pull-secrets\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41866977-9a3b-472d-9b20-1092eb4f0976-image-registry-private-configuration\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41866977-9a3b-472d-9b20-1092eb4f0976-ca-trust-extracted\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05507663-503c-4ec6-a483-4552ea884eb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.102578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-registry-tls\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.102578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05507663-503c-4ec6-a483-4552ea884eb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.102578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.102568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2m85\" (UniqueName: \"kubernetes.io/projected/05507663-503c-4ec6-a483-4552ea884eb8-kube-api-access-d2m85\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.103058 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.103039    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41866977-9a3b-472d-9b20-1092eb4f0976-registry-certificates\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.103155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.103043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41866977-9a3b-472d-9b20-1092eb4f0976-trusted-ca\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.106204 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.106187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-registry-tls\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.106290 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.106252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41866977-9a3b-472d-9b20-1092eb4f0976-image-registry-private-configuration\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.106434 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.106413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41866977-9a3b-472d-9b20-1092eb4f0976-installation-pull-secrets\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.114416 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.114397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gmh97"]
Jul 29 19:15:57.132251 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.132228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxs74\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-kube-api-access-mxs74\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.132337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.132263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41866977-9a3b-472d-9b20-1092eb4f0976-bound-sa-token\") pod \"image-registry-76ff66c997-hmtbf\" (UID: \"41866977-9a3b-472d-9b20-1092eb4f0976\") " pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.202919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.202883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hbrc\" (UniqueName: \"kubernetes.io/projected/da689ff5-458d-4265-8b27-d217b252f2e4-kube-api-access-8hbrc\") pod \"ingress-canary-zbbtz\" (UID: \"da689ff5-458d-4265-8b27-d217b252f2e4\") " pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.202919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.202924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6aac30ac-b63d-4411-9c11-6564aa6b15a0-config-volume\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.203143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.202991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05507663-503c-4ec6-a483-4552ea884eb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.203143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05507663-503c-4ec6-a483-4552ea884eb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.203143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6aac30ac-b63d-4411-9c11-6564aa6b15a0-tmp-dir\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.203143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2m85\" (UniqueName: \"kubernetes.io/projected/05507663-503c-4ec6-a483-4552ea884eb8-kube-api-access-d2m85\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.203143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da689ff5-458d-4265-8b27-d217b252f2e4-cert\") pod \"ingress-canary-zbbtz\" (UID: \"da689ff5-458d-4265-8b27-d217b252f2e4\") " pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.203143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ch4\" (UniqueName: \"kubernetes.io/projected/6aac30ac-b63d-4411-9c11-6564aa6b15a0-kube-api-access-22ch4\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.203411 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05507663-503c-4ec6-a483-4552ea884eb8-data-volume\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.203411 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05507663-503c-4ec6-a483-4552ea884eb8-crio-socket\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.203411 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aac30ac-b63d-4411-9c11-6564aa6b15a0-metrics-tls\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.203411 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203363    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05507663-503c-4ec6-a483-4552ea884eb8-crio-socket\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.203617 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05507663-503c-4ec6-a483-4552ea884eb8-data-volume\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.203729 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.203713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05507663-503c-4ec6-a483-4552ea884eb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.205249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.205233    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05507663-503c-4ec6-a483-4552ea884eb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.205485 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.205453    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da689ff5-458d-4265-8b27-d217b252f2e4-cert\") pod \"ingress-canary-zbbtz\" (UID: \"da689ff5-458d-4265-8b27-d217b252f2e4\") " pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.211437 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.211383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hbrc\" (UniqueName: \"kubernetes.io/projected/da689ff5-458d-4265-8b27-d217b252f2e4-kube-api-access-8hbrc\") pod \"ingress-canary-zbbtz\" (UID: \"da689ff5-458d-4265-8b27-d217b252f2e4\") " pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.211729 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.211712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2m85\" (UniqueName: \"kubernetes.io/projected/05507663-503c-4ec6-a483-4552ea884eb8-kube-api-access-d2m85\") pod \"insights-runtime-extractor-6l97r\" (UID: \"05507663-503c-4ec6-a483-4552ea884eb8\") " pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.269647 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.269617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.282920 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.282890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:57.304214 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.304067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aac30ac-b63d-4411-9c11-6564aa6b15a0-metrics-tls\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.304214 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.304098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6aac30ac-b63d-4411-9c11-6564aa6b15a0-config-volume\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.304214 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.304147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6aac30ac-b63d-4411-9c11-6564aa6b15a0-tmp-dir\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.304349 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.304298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ch4\" (UniqueName: \"kubernetes.io/projected/6aac30ac-b63d-4411-9c11-6564aa6b15a0-kube-api-access-22ch4\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.304450 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.304433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6aac30ac-b63d-4411-9c11-6564aa6b15a0-tmp-dir\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.304699 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.304680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6aac30ac-b63d-4411-9c11-6564aa6b15a0-config-volume\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.306225 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.306210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aac30ac-b63d-4411-9c11-6564aa6b15a0-metrics-tls\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.313368 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.313346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ch4\" (UniqueName: \"kubernetes.io/projected/6aac30ac-b63d-4411-9c11-6564aa6b15a0-kube-api-access-22ch4\") pod \"dns-default-gmh97\" (UID: \"6aac30ac-b63d-4411-9c11-6564aa6b15a0\") " pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.316257 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.316236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zbbtz"
Jul 29 19:15:57.326405 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.326386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6l97r"
Jul 29 19:15:57.357011 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.356977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:57.399105 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.398793    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gmh97"
Jul 29 19:15:57.529832 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.529802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zbbtz"]
Jul 29 19:15:57.530387 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.530366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76ff66c997-hmtbf"]
Jul 29 19:15:57.568713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.568680    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6l97r"]
Jul 29 19:15:57.583262 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:57.583230    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05507663_503c_4ec6_a483_4552ea884eb8.slice/crio-b8c6845ba7402b4b19e21700f23e73ab2da1753e786f9eeaa8d0954e07a641b8 WatchSource:0}: Error finding container b8c6845ba7402b4b19e21700f23e73ab2da1753e786f9eeaa8d0954e07a641b8: Status 404 returned error can't find the container with id b8c6845ba7402b4b19e21700f23e73ab2da1753e786f9eeaa8d0954e07a641b8
Jul 29 19:15:57.583634 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.583615    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gmh97"]
Jul 29 19:15:57.587012 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:15:57.586990    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aac30ac_b63d_4411_9c11_6564aa6b15a0.slice/crio-a8f313414cbe2322a805f383d6ccce6840db5f3dfaec68a19bac4f14ac700641 WatchSource:0}: Error finding container a8f313414cbe2322a805f383d6ccce6840db5f3dfaec68a19bac4f14ac700641: Status 404 returned error can't find the container with id a8f313414cbe2322a805f383d6ccce6840db5f3dfaec68a19bac4f14ac700641
Jul 29 19:15:57.730972 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.730861    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:57.832586 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.832529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:57.910730 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.910688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmh97" event={"ID":"6aac30ac-b63d-4411-9c11-6564aa6b15a0","Type":"ContainerStarted","Data":"a8f313414cbe2322a805f383d6ccce6840db5f3dfaec68a19bac4f14ac700641"}
Jul 29 19:15:57.912193 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.912166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76ff66c997-hmtbf" event={"ID":"41866977-9a3b-472d-9b20-1092eb4f0976","Type":"ContainerStarted","Data":"e69932bfabd09233e33646228f46000b473a2522fd3870ace229b31fbdb99e34"}
Jul 29 19:15:57.912313 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.912216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76ff66c997-hmtbf" event={"ID":"41866977-9a3b-472d-9b20-1092eb4f0976","Type":"ContainerStarted","Data":"413c43c8067a6bd4ec8ffd1ed4e50d541211899cbf385d0127fdd90bb734161c"}
Jul 29 19:15:57.912313 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.912281    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:15:57.913434 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.913404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zbbtz" event={"ID":"da689ff5-458d-4265-8b27-d217b252f2e4","Type":"ContainerStarted","Data":"567d002a884f92803af961ae0cc8ccaeb03282419e28eb160bc6bcd6c9412dab"}
Jul 29 19:15:57.914613 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.914592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6l97r" event={"ID":"05507663-503c-4ec6-a483-4552ea884eb8","Type":"ContainerStarted","Data":"b8c6845ba7402b4b19e21700f23e73ab2da1753e786f9eeaa8d0954e07a641b8"}
Jul 29 19:15:57.932715 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:57.932670    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76ff66c997-hmtbf" podStartSLOduration=6.932654619 podStartE2EDuration="6.932654619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:57.932124261 +0000 UTC m=+51.827941529" watchObservedRunningTime="2026-07-29 19:15:57.932654619 +0000 UTC m=+51.828471907"
Jul 29 19:15:58.215235 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.215199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:58.289235 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.289195    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:58.710083 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.710039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:15:58.710366 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.710348    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:15:58.710483 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.710456    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:15:58.713292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.713165    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8b4l\""
Jul 29 19:15:58.714746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.713884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhwzv\""
Jul 29 19:15:58.714746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.714119    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:15:58.714746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.714319    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:15:58.714746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.714299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:15:58.714746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.714629    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:15:58.980166 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:15:58.979907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:01.174847 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:01.174814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:01.243091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:01.243057    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:02.077632 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:02.077597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:02.745027 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:02.744764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:03.915240 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:03.915214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:04.017349 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.017263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:04.116671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.116634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:04.935260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.935179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmh97" event={"ID":"6aac30ac-b63d-4411-9c11-6564aa6b15a0","Type":"ContainerStarted","Data":"cc07d71df4fb409742be56c0c83b4bbf71672f4d4922909d863a7fc7e02505ab"}
Jul 29 19:16:04.935260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.935234    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmh97" event={"ID":"6aac30ac-b63d-4411-9c11-6564aa6b15a0","Type":"ContainerStarted","Data":"257db907ad709aa0112678942c83899d6476d7666b953abebf4fd4925331743b"}
Jul 29 19:16:04.935723 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.935284    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gmh97"
Jul 29 19:16:04.936718 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.936692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zbbtz" event={"ID":"da689ff5-458d-4265-8b27-d217b252f2e4","Type":"ContainerStarted","Data":"c106936e2302df5abf3d26406d25b7b7ce2caffcbd4396a813eaa0a987f3f5a5"}
Jul 29 19:16:04.938176 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.938158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6l97r" event={"ID":"05507663-503c-4ec6-a483-4552ea884eb8","Type":"ContainerStarted","Data":"682937d53d4b273e707aaecf0c19f6ee4de391a5449f1805b115ab9c9abb0842"}
Jul 29 19:16:04.981833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:04.981780    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gmh97" podStartSLOduration=1.302087456 podStartE2EDuration="7.981760474s" totalImagesPullingTime="6.679673018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:04.978178204 +0000 UTC m=+58.873995466" watchObservedRunningTime="2026-07-29 19:16:04.981760474 +0000 UTC m=+58.877577744"
Jul 29 19:16:05.022831 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:05.022730    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zbbtz" podStartSLOduration=2.30149283 podStartE2EDuration="9.02271085s" totalImagesPullingTime="6.72121802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:05.021965946 +0000 UTC m=+58.917783216" watchObservedRunningTime="2026-07-29 19:16:05.02271085 +0000 UTC m=+58.918528117"
Jul 29 19:16:05.892589 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:05.892540    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:05.992974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:05.992929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:06.077216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:06.077174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:06.159088 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:06.159021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:06.261125 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:06.261095    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:07.865999 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:07.865965    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s6vg"
Jul 29 19:16:08.491491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:08.491458    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:08.594390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:08.594355    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:08.898762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:08.898723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:08.951607 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:08.951572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6l97r" event={"ID":"05507663-503c-4ec6-a483-4552ea884eb8","Type":"ContainerStarted","Data":"2080faddce2322ee59e7956240a5125c0b61c622db21b042a88dac7c05ca224c"}
Jul 29 19:16:11.031427 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.031396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:11.163193 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.163154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:11.304355 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.304268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:11.331566 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.331515    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"]
Jul 29 19:16:11.350812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.350776    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"]
Jul 29 19:16:11.350963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.350922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.353503 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.353469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6kdxc\""
Jul 29 19:16:11.353763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.353739    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 19:16:11.353892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.353743    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 19:16:11.354468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.354381    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 19:16:11.354468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.354414    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 19:16:11.354468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.354443    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 19:16:11.376732 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.376677    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w2l6d"]
Jul 29 19:16:11.380813 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.380789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.383100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.383078    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wq7jd\""
Jul 29 19:16:11.383231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.383079    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 19:16:11.383380 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.383362    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 19:16:11.383709 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.383691    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 19:16:11.434451 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.434418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6acc4872-8096-44fd-9255-0c07cbfb6738-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.434707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.434471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6acc4872-8096-44fd-9255-0c07cbfb6738-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.434707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.434540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6acc4872-8096-44fd-9255-0c07cbfb6738-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.434707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.434577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6d5\" (UniqueName: \"kubernetes.io/projected/6acc4872-8096-44fd-9255-0c07cbfb6738-kube-api-access-gf6d5\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.535856 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.535821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536015 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.535889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6da44898-0c22-429a-8b19-ec85b783d0b8-metrics-client-ca\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536015 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.535938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6acc4872-8096-44fd-9255-0c07cbfb6738-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.536015 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.535964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6acc4872-8096-44fd-9255-0c07cbfb6738-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.536015 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.535984    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-tls\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536189 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-wtmp\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536189 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6d5\" (UniqueName: \"kubernetes.io/projected/6acc4872-8096-44fd-9255-0c07cbfb6738-kube-api-access-gf6d5\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.536189 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-sys\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536328 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6acc4872-8096-44fd-9255-0c07cbfb6738-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.536328 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536423 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-textfile\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536423 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-root\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536532 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rpbr\" (UniqueName: \"kubernetes.io/projected/6da44898-0c22-429a-8b19-ec85b783d0b8-kube-api-access-4rpbr\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.536920 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.536899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6acc4872-8096-44fd-9255-0c07cbfb6738-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.539702 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.539681    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6acc4872-8096-44fd-9255-0c07cbfb6738-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.539797 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.539707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6acc4872-8096-44fd-9255-0c07cbfb6738-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.543970 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.543945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6d5\" (UniqueName: \"kubernetes.io/projected/6acc4872-8096-44fd-9255-0c07cbfb6738-kube-api-access-gf6d5\") pod \"openshift-state-metrics-b8f49f5c6-6vbqc\" (UID: \"6acc4872-8096-44fd-9255-0c07cbfb6738\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.637581 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6da44898-0c22-429a-8b19-ec85b783d0b8-metrics-client-ca\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-tls\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-wtmp\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-sys\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-sys\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:16:11.637760    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-textfile\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-root\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-wtmp\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:16:11.637844    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-tls podName:6da44898-0c22-429a-8b19-ec85b783d0b8 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.137823041 +0000 UTC m=+66.033640291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-tls") pod "node-exporter-w2l6d" (UID: "6da44898-0c22-429a-8b19-ec85b783d0b8") : secret "node-exporter-tls" not found
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6da44898-0c22-429a-8b19-ec85b783d0b8-root\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.637874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rpbr\" (UniqueName: \"kubernetes.io/projected/6da44898-0c22-429a-8b19-ec85b783d0b8-kube-api-access-4rpbr\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.638165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.637898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.638165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.638029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6da44898-0c22-429a-8b19-ec85b783d0b8-metrics-client-ca\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.638165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.638083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-textfile\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.638328 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.638313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.639708 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.639690    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.655637 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.655613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rpbr\" (UniqueName: \"kubernetes.io/projected/6da44898-0c22-429a-8b19-ec85b783d0b8-kube-api-access-4rpbr\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:11.661511 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.661495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"
Jul 29 19:16:11.776695 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.776666    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:11.789708 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.789686    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc"]
Jul 29 19:16:11.791245 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:11.791221    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acc4872_8096_44fd_9255_0c07cbfb6738.slice/crio-f4daa62c6bf22d0b0b34e757b172e7474530195f195f15c669df17914d5e7c09 WatchSource:0}: Error finding container f4daa62c6bf22d0b0b34e757b172e7474530195f195f15c669df17914d5e7c09: Status 404 returned error can't find the container with id f4daa62c6bf22d0b0b34e757b172e7474530195f195f15c669df17914d5e7c09
Jul 29 19:16:11.874016 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.873987    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:11.963608 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.963572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6l97r" event={"ID":"05507663-503c-4ec6-a483-4552ea884eb8","Type":"ContainerStarted","Data":"af229dee3bf6a35aa251ad58fa3edec6ba9f013ab3c598691c0723dbb5e845d6"}
Jul 29 19:16:11.965323 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.965298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc" event={"ID":"6acc4872-8096-44fd-9255-0c07cbfb6738","Type":"ContainerStarted","Data":"1890b2f631bca70c02a4a2eb61367de259f447a17554a45b12bbb6c1af737cce"}
Jul 29 19:16:11.965434 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.965348    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc" event={"ID":"6acc4872-8096-44fd-9255-0c07cbfb6738","Type":"ContainerStarted","Data":"4cfb76a0a763176a27b3adac00cae528379e1a49fa7ce2ad3207839409964e19"}
Jul 29 19:16:11.965434 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.965373    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc" event={"ID":"6acc4872-8096-44fd-9255-0c07cbfb6738","Type":"ContainerStarted","Data":"f4daa62c6bf22d0b0b34e757b172e7474530195f195f15c669df17914d5e7c09"}
Jul 29 19:16:11.974561 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.974525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:11.987593 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:11.987519    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6l97r" podStartSLOduration=2.173295731 podStartE2EDuration="15.987504576s" totalImagesPullingTime="13.814208845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:11.986151494 +0000 UTC m=+65.881968762" watchObservedRunningTime="2026-07-29 19:16:11.987504576 +0000 UTC m=+65.883321843"
Jul 29 19:16:12.077601 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.077506    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:12.142849 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.142816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-tls\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:12.145071 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.145049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6da44898-0c22-429a-8b19-ec85b783d0b8-node-exporter-tls\") pod \"node-exporter-w2l6d\" (UID: \"6da44898-0c22-429a-8b19-ec85b783d0b8\") " pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:12.293783 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.293747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w2l6d"
Jul 29 19:16:12.302173 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:12.302148    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da44898_0c22_429a_8b19_ec85b783d0b8.slice/crio-1594847998d774e59a6a87b91d0700d2b2aaf38e6887ee3698a1dfad06ee0f7e WatchSource:0}: Error finding container 1594847998d774e59a6a87b91d0700d2b2aaf38e6887ee3698a1dfad06ee0f7e: Status 404 returned error can't find the container with id 1594847998d774e59a6a87b91d0700d2b2aaf38e6887ee3698a1dfad06ee0f7e
Jul 29 19:16:12.344771 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.344688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:16:12.352945 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.352926    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:16:12.357156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.357134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f310751-a3b2-414d-aa3e-5c886331cdc6-metrics-certs\") pod \"network-metrics-daemon-bqgqz\" (UID: \"8f310751-a3b2-414d-aa3e-5c886331cdc6\") " pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:16:12.395010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.394977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:12.445387 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.445351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:16:12.445387 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.445385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:16:12.450256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.450239    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:16:12.450489 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.450475    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:16:12.457940 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.457917    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:16:12.458053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.458002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ed65c4-fe8d-4a3d-986b-8fb9986e86db-original-pull-secret\") pod \"global-pull-secret-syncer-kklpt\" (UID: \"27ed65c4-fe8d-4a3d-986b-8fb9986e86db\") " pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:16:12.468755 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.468727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzsp4\" (UniqueName: \"kubernetes.io/projected/e45bf47f-ef8e-403a-8897-eb31f691c9a6-kube-api-access-jzsp4\") pod \"network-check-target-756dk\" (UID: \"e45bf47f-ef8e-403a-8897-eb31f691c9a6\") " pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:16:12.497090 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.497058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:12.529086 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.529062    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8b4l\""
Jul 29 19:16:12.537816 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.537792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqgqz"
Jul 29 19:16:12.541083 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.541064    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhwzv\""
Jul 29 19:16:12.546998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.546978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kklpt"
Jul 29 19:16:12.549342 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.549315    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:16:12.705601 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.705495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqgqz"]
Jul 29 19:16:12.709381 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:12.709342    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f310751_a3b2_414d_aa3e_5c886331cdc6.slice/crio-4ea2e999e644f80a369903e0f088bc20a5108d0672978543e1d02ec037ee4d07 WatchSource:0}: Error finding container 4ea2e999e644f80a369903e0f088bc20a5108d0672978543e1d02ec037ee4d07: Status 404 returned error can't find the container with id 4ea2e999e644f80a369903e0f088bc20a5108d0672978543e1d02ec037ee4d07
Jul 29 19:16:12.742284 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.742249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:12.933376 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.933290    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kklpt"]
Jul 29 19:16:12.936953 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.936923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-756dk"]
Jul 29 19:16:12.971631 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.971592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqgqz" event={"ID":"8f310751-a3b2-414d-aa3e-5c886331cdc6","Type":"ContainerStarted","Data":"4ea2e999e644f80a369903e0f088bc20a5108d0672978543e1d02ec037ee4d07"}
Jul 29 19:16:12.973011 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:12.972978    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2l6d" event={"ID":"6da44898-0c22-429a-8b19-ec85b783d0b8","Type":"ContainerStarted","Data":"1594847998d774e59a6a87b91d0700d2b2aaf38e6887ee3698a1dfad06ee0f7e"}
Jul 29 19:16:13.107784 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:13.107748    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ed65c4_fe8d_4a3d_986b_8fb9986e86db.slice/crio-c5ca1b394ed73c1257bb655ab2c06cae600557b64e26dce0255e50a75a9fb66c WatchSource:0}: Error finding container c5ca1b394ed73c1257bb655ab2c06cae600557b64e26dce0255e50a75a9fb66c: Status 404 returned error can't find the container with id c5ca1b394ed73c1257bb655ab2c06cae600557b64e26dce0255e50a75a9fb66c
Jul 29 19:16:13.108338 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:13.108201    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45bf47f_ef8e_403a_8897_eb31f691c9a6.slice/crio-e552fe40e9009df7c36d47c1b99276cb838fe615d63349a1e5627777d6b99fb2 WatchSource:0}: Error finding container e552fe40e9009df7c36d47c1b99276cb838fe615d63349a1e5627777d6b99fb2: Status 404 returned error can't find the container with id e552fe40e9009df7c36d47c1b99276cb838fe615d63349a1e5627777d6b99fb2
Jul 29 19:16:13.240071 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.239958    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:13.341239 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.341216    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:13.554567 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.554513    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"]
Jul 29 19:16:13.557649 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.557614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.560297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.560243    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d8dsm\""
Jul 29 19:16:13.560297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.560243    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 19:16:13.560486 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.560355    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 19:16:13.560555 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.560481    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 19:16:13.560555 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.560530    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4479movm18gn4\""
Jul 29 19:16:13.560784 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.560763    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 19:16:13.561153 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.561064    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 19:16:13.575582 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.575536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"]
Jul 29 19:16:13.658371 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.658538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-grpc-tls\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.658538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.658677 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.658677 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2slk\" (UniqueName: \"kubernetes.io/projected/b7d5b195-e410-44f0-a478-6b7bee588676-kube-api-access-h2slk\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.658774 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-tls\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.658831 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.658887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.658862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7d5b195-e410-44f0-a478-6b7bee588676-metrics-client-ca\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760247 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7d5b195-e410-44f0-a478-6b7bee588676-metrics-client-ca\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-grpc-tls\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2slk\" (UniqueName: \"kubernetes.io/projected/b7d5b195-e410-44f0-a478-6b7bee588676-kube-api-access-h2slk\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.760777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.760435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-tls\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.761238 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.761197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7d5b195-e410-44f0-a478-6b7bee588676-metrics-client-ca\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.763361 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.763333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.763476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.763392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-tls\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.763736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.763693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.763736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.763703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.763922 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.763806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.764013 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.763992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7d5b195-e410-44f0-a478-6b7bee588676-secret-grpc-tls\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.769603 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.769529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2slk\" (UniqueName: \"kubernetes.io/projected/b7d5b195-e410-44f0-a478-6b7bee588676-kube-api-access-h2slk\") pod \"thanos-querier-c9d59bd44-sz8zm\" (UID: \"b7d5b195-e410-44f0-a478-6b7bee588676\") " pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.867950 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.867866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:13.979835 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.979798    2576 generic.go:356] "Generic (PLEG): container finished" podID="6da44898-0c22-429a-8b19-ec85b783d0b8" containerID="99e522b8fdbf331ccf5f370f0bc9a7c3b5ab91fa41bb34159194b967d171097b" exitCode=0
Jul 29 19:16:13.979961 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.979886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2l6d" event={"ID":"6da44898-0c22-429a-8b19-ec85b783d0b8","Type":"ContainerDied","Data":"99e522b8fdbf331ccf5f370f0bc9a7c3b5ab91fa41bb34159194b967d171097b"}
Jul 29 19:16:13.984750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.984679    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc" event={"ID":"6acc4872-8096-44fd-9255-0c07cbfb6738","Type":"ContainerStarted","Data":"ae92320af9d1118494b01bf097d6ec0eeabb630fd70f31a5a11ffc7f8d50a1e8"}
Jul 29 19:16:13.986634 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.986602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-756dk" event={"ID":"e45bf47f-ef8e-403a-8897-eb31f691c9a6","Type":"ContainerStarted","Data":"e552fe40e9009df7c36d47c1b99276cb838fe615d63349a1e5627777d6b99fb2"}
Jul 29 19:16:13.988192 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:13.988170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kklpt" event={"ID":"27ed65c4-fe8d-4a3d-986b-8fb9986e86db","Type":"ContainerStarted","Data":"c5ca1b394ed73c1257bb655ab2c06cae600557b64e26dce0255e50a75a9fb66c"}
Jul 29 19:16:14.043981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.042373    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6vbqc" podStartSLOduration=1.6187845109999999 podStartE2EDuration="3.042351344s" totalImagesPullingTime="1.423566833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:14.041486204 +0000 UTC m=+67.937303475" watchObservedRunningTime="2026-07-29 19:16:14.042351344 +0000 UTC m=+67.938168612"
Jul 29 19:16:14.045593 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.045486    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"]
Jul 29 19:16:14.052202 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:14.052170    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d5b195_e410_44f0_a478_6b7bee588676.slice/crio-e79316c1781a5b2b409d092ddb1354b1220f5dba05918afc2cbcb18e1bc9199a WatchSource:0}: Error finding container e79316c1781a5b2b409d092ddb1354b1220f5dba05918afc2cbcb18e1bc9199a: Status 404 returned error can't find the container with id e79316c1781a5b2b409d092ddb1354b1220f5dba05918afc2cbcb18e1bc9199a
Jul 29 19:16:14.345491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.345456    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:14.480767 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.480694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:14.584199 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.584162    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:14.784104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.784066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:14.853298 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.853234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:14.943076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.943045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gmh97"
Jul 29 19:16:14.996291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.996256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqgqz" event={"ID":"8f310751-a3b2-414d-aa3e-5c886331cdc6","Type":"ContainerStarted","Data":"bf86cbb05ccd4deb6c528461d5f8ff25f0b4c1f7c435727e62886cdf6722cd4f"}
Jul 29 19:16:14.996509 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.996320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqgqz" event={"ID":"8f310751-a3b2-414d-aa3e-5c886331cdc6","Type":"ContainerStarted","Data":"c8685946bd1a8f2c57d168b65ae752829b56b4d9661de43cdd2def4978d52ac6"}
Jul 29 19:16:14.999538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.999496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2l6d" event={"ID":"6da44898-0c22-429a-8b19-ec85b783d0b8","Type":"ContainerStarted","Data":"c593bd33da4f794ece569f55c38625ef83043249f7ffdb13e86567bdd3ed58db"}
Jul 29 19:16:14.999686 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:14.999584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2l6d" event={"ID":"6da44898-0c22-429a-8b19-ec85b783d0b8","Type":"ContainerStarted","Data":"70cf104d5f492d36f6bc55bd1477f5b01e134182704da24078f5d6932670ebc2"}
Jul 29 19:16:15.001722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.001533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" event={"ID":"b7d5b195-e410-44f0-a478-6b7bee588676","Type":"ContainerStarted","Data":"e79316c1781a5b2b409d092ddb1354b1220f5dba05918afc2cbcb18e1bc9199a"}
Jul 29 19:16:15.028562 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.023058    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bqgqz" podStartSLOduration=66.833673637 podStartE2EDuration="1m8.023036139s" totalImagesPullingTime="1.189362502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:15.021491574 +0000 UTC m=+68.917308845" watchObservedRunningTime="2026-07-29 19:16:15.023036139 +0000 UTC m=+68.918853408"
Jul 29 19:16:15.049121 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.048516    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w2l6d" podStartSLOduration=2.947783338 podStartE2EDuration="4.048493683s" totalImagesPullingTime="1.023602735s" totalInitContainerRuntime="77.10761ms" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:15.04748186 +0000 UTC m=+68.943299128" watchObservedRunningTime="2026-07-29 19:16:15.048493683 +0000 UTC m=+68.944310973"
Jul 29 19:16:15.171530 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.171420    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:15.272244 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.272177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:15.376425 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.376305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:15.564739 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.564659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:15.661387 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.661262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:15.737437 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:15.737405    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:16.085223 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.085177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:16.091724 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.091692    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"]
Jul 29 19:16:16.109114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.109083    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"]
Jul 29 19:16:16.109292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.109213    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:16.112704 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.112665    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6vvmg\""
Jul 29 19:16:16.112855 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.112711    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 19:16:16.136919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.136864    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56467bc574-nmzqj"]
Jul 29 19:16:16.159291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.159247    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56467bc574-nmzqj"]
Jul 29 19:16:16.159449 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.159387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.162056 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.162033    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 19:16:16.162439 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.162416    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 19:16:16.162539 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.162491    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 19:16:16.162624 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.162556    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hktpp\""
Jul 29 19:16:16.162678 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.162642    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 19:16:16.162941 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.162925    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 19:16:16.163244 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.163225    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 19:16:16.163448 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.163427    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 19:16:16.168497 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.168477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 19:16:16.179658 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.179629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtck5\" (UniqueName: \"kubernetes.io/projected/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-kube-api-access-vtck5\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:16.179795 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.179716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:16.181894 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.181867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:16.280853 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.280811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtck5\" (UniqueName: \"kubernetes.io/projected/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-kube-api-access-vtck5\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:16.281070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.280895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-service-ca\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.281070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.280927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-oauth-serving-cert\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.281070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.280965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp8hz\" (UniqueName: \"kubernetes.io/projected/4d05bf63-8516-4312-996b-b6ea89a0f676-kube-api-access-fp8hz\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.281070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.280991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-serving-cert\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.281070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.281054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-oauth-config\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.281320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.281121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-trusted-ca-bundle\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.281320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.281158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:16.281320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.281238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-console-config\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.281320 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:16:16.281273    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 29 19:16:16.281521 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:16:16.281328    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert podName:2814ee5d-1ec3-46d9-aa08-20ed5f5958ee nodeName:}" failed. No retries permitted until 2026-07-29 19:16:16.781312075 +0000 UTC m=+70.677129322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-mj9f8" (UID: "2814ee5d-1ec3-46d9-aa08-20ed5f5958ee") : secret "monitoring-plugin-cert" not found
Jul 29 19:16:16.289592 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.289568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtck5\" (UniqueName: \"kubernetes.io/projected/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-kube-api-access-vtck5\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:16.382754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.382654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp8hz\" (UniqueName: \"kubernetes.io/projected/4d05bf63-8516-4312-996b-b6ea89a0f676-kube-api-access-fp8hz\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.382754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.382699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-serving-cert\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.382754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.382728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-oauth-config\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.382766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-trusted-ca-bundle\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.382836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-console-config\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.382908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-service-ca\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.382932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-oauth-serving-cert\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383773 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.383747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-oauth-serving-cert\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383886 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.383778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-console-config\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383886 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.383836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-trusted-ca-bundle\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.383886 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.383854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-service-ca\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.385700 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.385671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-serving-cert\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.386315 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.386293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-oauth-config\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.392398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.392373    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp8hz\" (UniqueName: \"kubernetes.io/projected/4d05bf63-8516-4312-996b-b6ea89a0f676-kube-api-access-fp8hz\") pod \"console-56467bc574-nmzqj\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") " pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.470244 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.470201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:16.786331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.786284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:16.786505 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:16:16.786475    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 29 19:16:16.786596 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:16:16.786585    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert podName:2814ee5d-1ec3-46d9-aa08-20ed5f5958ee nodeName:}" failed. No retries permitted until 2026-07-29 19:16:17.786566444 +0000 UTC m=+71.682383711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-mj9f8" (UID: "2814ee5d-1ec3-46d9-aa08-20ed5f5958ee") : secret "monitoring-plugin-cert" not found
Jul 29 19:16:16.962931 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:16.962887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:17.599220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:17.599177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:17.797008 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:17.796967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:17.799685 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:17.799656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2814ee5d-1ec3-46d9-aa08-20ed5f5958ee-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mj9f8\" (UID: \"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:17.919893 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:17.919808    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:17.963361 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:17.963325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:18.162823 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:18.162791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:18.925631 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:18.925604    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76ff66c997-hmtbf"
Jul 29 19:16:19.019824 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.019695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" event={"ID":"b7d5b195-e410-44f0-a478-6b7bee588676","Type":"ContainerStarted","Data":"089a29870b6733f531baddb5ea6a5c5683ead93b2cda15440aaa28c85fb7a658"}
Jul 29 19:16:19.022929 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.022141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-756dk" event={"ID":"e45bf47f-ef8e-403a-8897-eb31f691c9a6","Type":"ContainerStarted","Data":"1f6e7445a3875791d04b0268cc3b052c805503f5daeb25518e9ff1422abf426a"}
Jul 29 19:16:19.022929 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.022403    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:16:19.064950 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.064893    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-756dk" podStartSLOduration=66.268954641 podStartE2EDuration="1m12.064871372s" totalImagesPullingTime="5.795916731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:19.054050273 +0000 UTC m=+72.949867562" watchObservedRunningTime="2026-07-29 19:16:19.064871372 +0000 UTC m=+72.960688685"
Jul 29 19:16:19.081470 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.081439    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56467bc574-nmzqj"]
Jul 29 19:16:19.082471 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:19.082445    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d05bf63_8516_4312_996b_b6ea89a0f676.slice/crio-0c6b0fadb07666023ea49bf36047065acf45da9bfb0ec5fce8bc0e6f40467f93 WatchSource:0}: Error finding container 0c6b0fadb07666023ea49bf36047065acf45da9bfb0ec5fce8bc0e6f40467f93: Status 404 returned error can't find the container with id 0c6b0fadb07666023ea49bf36047065acf45da9bfb0ec5fce8bc0e6f40467f93
Jul 29 19:16:19.107092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.107056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"]
Jul 29 19:16:19.163579 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.163535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:19.242388 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.242354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:19.359130 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.359101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:19.650900 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:19.650822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:20.030923 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:20.030883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" event={"ID":"b7d5b195-e410-44f0-a478-6b7bee588676","Type":"ContainerStarted","Data":"992f21bfbf6ee8a4129ad83718a3e4bbfb2764630ad004887168a6a08e7d7d9f"}
Jul 29 19:16:20.031439 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:20.031017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" event={"ID":"b7d5b195-e410-44f0-a478-6b7bee588676","Type":"ContainerStarted","Data":"a5ae243ffa6c58ec56faac338acad40c6ad3a303b57b15cd618a1f5f0143e4e8"}
Jul 29 19:16:20.034116 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:20.034086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kklpt" event={"ID":"27ed65c4-fe8d-4a3d-986b-8fb9986e86db","Type":"ContainerStarted","Data":"89e6c462fa9d432267ada1ac9018ef525ee10bdf163ff7095af714f57a5f20a7"}
Jul 29 19:16:20.038339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:20.038262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8" event={"ID":"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee","Type":"ContainerStarted","Data":"b011d50b6b053aa597ec959107f12cc58685d7ab17eb9e28d0bf7dc042092699"}
Jul 29 19:16:20.040452 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:20.040293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56467bc574-nmzqj" event={"ID":"4d05bf63-8516-4312-996b-b6ea89a0f676","Type":"ContainerStarted","Data":"0c6b0fadb07666023ea49bf36047065acf45da9bfb0ec5fce8bc0e6f40467f93"}
Jul 29 19:16:20.056801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:20.056555    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kklpt" podStartSLOduration=67.260909924 podStartE2EDuration="1m13.056527453s" totalImagesPullingTime="5.795617529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:20.054931063 +0000 UTC m=+73.950748333" watchObservedRunningTime="2026-07-29 19:16:20.056527453 +0000 UTC m=+73.952344723"
Jul 29 19:16:21.045956 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.045918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8" event={"ID":"2814ee5d-1ec3-46d9-aa08-20ed5f5958ee","Type":"ContainerStarted","Data":"87b559fe1e49462d3b858610c1f7afa00a9d2616842635166689a6eec26eab87"}
Jul 29 19:16:21.046530 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.046102    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:21.050373 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.050342    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" event={"ID":"b7d5b195-e410-44f0-a478-6b7bee588676","Type":"ContainerStarted","Data":"82048c6c64f0c347ff41e8f592cae23d8bd32f04bfd2c3d8b38507492088b517"}
Jul 29 19:16:21.050537 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.050447    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" event={"ID":"b7d5b195-e410-44f0-a478-6b7bee588676","Type":"ContainerStarted","Data":"23bf875f98f29115dd7801b4fa3a076be1810185919e3d199865a3c629e0e15e"}
Jul 29 19:16:21.050537 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.050496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" event={"ID":"b7d5b195-e410-44f0-a478-6b7bee588676","Type":"ContainerStarted","Data":"a55b8a32b1395affdc2d83c2182c6262258a6e79753fd843a03c6e7aa4ded16e"}
Jul 29 19:16:21.050681 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.050565    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:21.053171 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.053151    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8"
Jul 29 19:16:21.067147 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.067089    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mj9f8" podStartSLOduration=3.512704903 podStartE2EDuration="5.067074056s" totalImagesPullingTime="1.554369153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:21.065564267 +0000 UTC m=+74.961381538" watchObservedRunningTime="2026-07-29 19:16:21.067074056 +0000 UTC m=+74.962891354"
Jul 29 19:16:21.135346 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.134994    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm" podStartSLOduration=1.7765245269999999 podStartE2EDuration="8.13496947s" totalImagesPullingTime="6.358444943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:21.131629711 +0000 UTC m=+75.027446982" watchObservedRunningTime="2026-07-29 19:16:21.13496947 +0000 UTC m=+75.030786741"
Jul 29 19:16:21.237487 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.237439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:21.346047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:21.345953    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:22.091156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.091119    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56467bc574-nmzqj"]
Jul 29 19:16:22.139096 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.139063    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4fdd6766-hdbrb"]
Jul 29 19:16:22.148385 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.148356    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.159318 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.159286    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4fdd6766-hdbrb"]
Jul 29 19:16:22.236479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.236447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5jdd\" (UniqueName: \"kubernetes.io/projected/a8274826-5f38-477c-8374-2e1a9935956e-kube-api-access-q5jdd\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.236681 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.236514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-oauth-config\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.236681 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.236667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-console-config\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.236809 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.236759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-oauth-serving-cert\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.236809 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.236801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-serving-cert\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.236972 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.236895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-trusted-ca-bundle\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.237128 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.237100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-service-ca\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.290066 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.290036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:22.338502 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.338478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-service-ca\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.338636 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.338532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5jdd\" (UniqueName: \"kubernetes.io/projected/a8274826-5f38-477c-8374-2e1a9935956e-kube-api-access-q5jdd\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.338636 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.338587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-oauth-config\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.338636 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.338619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-console-config\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.338800 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.338746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-oauth-serving-cert\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.338800 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.338784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-serving-cert\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.338915 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.338826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-trusted-ca-bundle\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.339520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.339495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-oauth-serving-cert\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.339644 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.339593    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-service-ca\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.339767 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.339736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-console-config\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.340145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.340118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-trusted-ca-bundle\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.341339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.341273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-oauth-config\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.341514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.341495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-serving-cert\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.346979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.346959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5jdd\" (UniqueName: \"kubernetes.io/projected/a8274826-5f38-477c-8374-2e1a9935956e-kube-api-access-q5jdd\") pod \"console-b4fdd6766-hdbrb\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") " pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.387962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.387924    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:22.460962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.460923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:22.609431 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.609346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4fdd6766-hdbrb"]
Jul 29 19:16:22.613337 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:16:22.613309    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8274826_5f38_477c_8374_2e1a9935956e.slice/crio-53f55ebfeff6080f3c159bd6a7856ddb20073072244430bf8e0d0beee8e52b77 WatchSource:0}: Error finding container 53f55ebfeff6080f3c159bd6a7856ddb20073072244430bf8e0d0beee8e52b77: Status 404 returned error can't find the container with id 53f55ebfeff6080f3c159bd6a7856ddb20073072244430bf8e0d0beee8e52b77
Jul 29 19:16:22.916401 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:22.916320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:23.021330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:23.021289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:23.059097 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:23.059062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fdd6766-hdbrb" event={"ID":"a8274826-5f38-477c-8374-2e1a9935956e","Type":"ContainerStarted","Data":"4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a"}
Jul 29 19:16:23.059285 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:23.059121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fdd6766-hdbrb" event={"ID":"a8274826-5f38-477c-8374-2e1a9935956e","Type":"ContainerStarted","Data":"53f55ebfeff6080f3c159bd6a7856ddb20073072244430bf8e0d0beee8e52b77"}
Jul 29 19:16:23.060607 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:23.060576    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56467bc574-nmzqj" event={"ID":"4d05bf63-8516-4312-996b-b6ea89a0f676","Type":"ContainerStarted","Data":"c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1"}
Jul 29 19:16:23.115665 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:23.115611    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56467bc574-nmzqj" podStartSLOduration=3.896438343 podStartE2EDuration="7.115594562s" totalImagesPullingTime="3.219156219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:23.114953844 +0000 UTC m=+77.010771114" watchObservedRunningTime="2026-07-29 19:16:23.115594562 +0000 UTC m=+77.011411825"
Jul 29 19:16:23.116040 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:23.115714    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b4fdd6766-hdbrb" podStartSLOduration=1.115708487 podStartE2EDuration="1.115708487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:23.089529455 +0000 UTC m=+76.985346727" watchObservedRunningTime="2026-07-29 19:16:23.115708487 +0000 UTC m=+77.011525755"
Jul 29 19:16:24.033889 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:24.033856    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:24.130692 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:24.130653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:24.232249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:24.232210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:24.372264 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:24.372181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:24.471749 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:24.471716    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:26.470853 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:26.470814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:27.013929 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:27.013896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:27.060169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:27.060145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c9d59bd44-sz8zm"
Jul 29 19:16:27.118854 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:27.118822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:32.461287 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:32.461147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:32.461287 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:32.461219    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:32.466149 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:32.466126    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:33.102597 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:33.102570    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:16:33.494347 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:33.494268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:33.591890 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:33.591862    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:39.032758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:39.032724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:39.129776 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:39.129745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:45.343405 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:45.343364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:45.447921 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:45.447887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:48.080444 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.080400    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56467bc574-nmzqj" podUID="4d05bf63-8516-4312-996b-b6ea89a0f676" containerName="console" containerID="cri-o://c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1" gracePeriod=15
Jul 29 19:16:48.847224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.847184    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:48.942960 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.942921    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-service-ca\") pod \"4d05bf63-8516-4312-996b-b6ea89a0f676\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") "
Jul 29 19:16:48.942960 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.942958    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-trusted-ca-bundle\") pod \"4d05bf63-8516-4312-996b-b6ea89a0f676\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") "
Jul 29 19:16:48.943220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943014    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-console-config\") pod \"4d05bf63-8516-4312-996b-b6ea89a0f676\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") "
Jul 29 19:16:48.943220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943038    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp8hz\" (UniqueName: \"kubernetes.io/projected/4d05bf63-8516-4312-996b-b6ea89a0f676-kube-api-access-fp8hz\") pod \"4d05bf63-8516-4312-996b-b6ea89a0f676\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") "
Jul 29 19:16:48.943220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-oauth-serving-cert\") pod \"4d05bf63-8516-4312-996b-b6ea89a0f676\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") "
Jul 29 19:16:48.943220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943133    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-oauth-config\") pod \"4d05bf63-8516-4312-996b-b6ea89a0f676\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") "
Jul 29 19:16:48.943220 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-serving-cert\") pod \"4d05bf63-8516-4312-996b-b6ea89a0f676\" (UID: \"4d05bf63-8516-4312-996b-b6ea89a0f676\") "
Jul 29 19:16:48.943519 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943411    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d05bf63-8516-4312-996b-b6ea89a0f676" (UID: "4d05bf63-8516-4312-996b-b6ea89a0f676"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:48.943656 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943520    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4d05bf63-8516-4312-996b-b6ea89a0f676" (UID: "4d05bf63-8516-4312-996b-b6ea89a0f676"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:48.943656 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943533    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-console-config" (OuterVolumeSpecName: "console-config") pod "4d05bf63-8516-4312-996b-b6ea89a0f676" (UID: "4d05bf63-8516-4312-996b-b6ea89a0f676"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:48.943656 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.943635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d05bf63-8516-4312-996b-b6ea89a0f676" (UID: "4d05bf63-8516-4312-996b-b6ea89a0f676"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:16:48.945521 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.945489    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d05bf63-8516-4312-996b-b6ea89a0f676-kube-api-access-fp8hz" (OuterVolumeSpecName: "kube-api-access-fp8hz") pod "4d05bf63-8516-4312-996b-b6ea89a0f676" (UID: "4d05bf63-8516-4312-996b-b6ea89a0f676"). InnerVolumeSpecName "kube-api-access-fp8hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:16:48.945646 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.945536    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d05bf63-8516-4312-996b-b6ea89a0f676" (UID: "4d05bf63-8516-4312-996b-b6ea89a0f676"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:16:48.945717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:48.945690    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d05bf63-8516-4312-996b-b6ea89a0f676" (UID: "4d05bf63-8516-4312-996b-b6ea89a0f676"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:16:49.044010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.043913    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-console-config\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:16:49.044010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.043948    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp8hz\" (UniqueName: \"kubernetes.io/projected/4d05bf63-8516-4312-996b-b6ea89a0f676-kube-api-access-fp8hz\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:16:49.044010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.043962    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-oauth-serving-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:16:49.044010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.043974    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-oauth-config\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:16:49.044010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.043985    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d05bf63-8516-4312-996b-b6ea89a0f676-console-serving-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:16:49.044010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.043996    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:16:49.044010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.044009    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d05bf63-8516-4312-996b-b6ea89a0f676-trusted-ca-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:16:49.159739 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.159704    2576 generic.go:356] "Generic (PLEG): container finished" podID="4d05bf63-8516-4312-996b-b6ea89a0f676" containerID="c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1" exitCode=0
Jul 29 19:16:49.160135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.159750    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56467bc574-nmzqj"
Jul 29 19:16:49.160135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.159790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56467bc574-nmzqj" event={"ID":"4d05bf63-8516-4312-996b-b6ea89a0f676","Type":"ContainerDied","Data":"c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1"}
Jul 29 19:16:49.160135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.159842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56467bc574-nmzqj" event={"ID":"4d05bf63-8516-4312-996b-b6ea89a0f676","Type":"ContainerDied","Data":"0c6b0fadb07666023ea49bf36047065acf45da9bfb0ec5fce8bc0e6f40467f93"}
Jul 29 19:16:49.160135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.159865    2576 scope.go:117] "RemoveContainer" containerID="c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1"
Jul 29 19:16:49.169024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.169002    2576 scope.go:117] "RemoveContainer" containerID="c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1"
Jul 29 19:16:49.169319 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:16:49.169298    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1\": container with ID starting with c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1 not found: ID does not exist" containerID="c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1"
Jul 29 19:16:49.169393 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.169326    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1"} err="failed to get container status \"c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1\": rpc error: code = NotFound desc = could not find container \"c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1\": container with ID starting with c0f5d7046bd004f1bbe4628c3e5a996f2824dc5edaba1c82ba0be70cba5f18b1 not found: ID does not exist"
Jul 29 19:16:49.182024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.181993    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56467bc574-nmzqj"]
Jul 29 19:16:49.185178 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:49.185141    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56467bc574-nmzqj"]
Jul 29 19:16:50.043149 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:50.043117    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-756dk"
Jul 29 19:16:50.714190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:50.714155    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d05bf63-8516-4312-996b-b6ea89a0f676" path="/var/lib/kubelet/pods/4d05bf63-8516-4312-996b-b6ea89a0f676/volumes"
Jul 29 19:16:54.456901 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:16:54.456868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:27.467559 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:27.467504    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:27.543242 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:27.543206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:29.886082 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:29.886046    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5887ffcbbc-bzjkn"]
Jul 29 19:17:29.886635 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:29.886483    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d05bf63-8516-4312-996b-b6ea89a0f676" containerName="console"
Jul 29 19:17:29.886635 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:29.886501    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d05bf63-8516-4312-996b-b6ea89a0f676" containerName="console"
Jul 29 19:17:29.886635 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:29.886582    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d05bf63-8516-4312-996b-b6ea89a0f676" containerName="console"
Jul 29 19:17:29.888605 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:29.888583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:29.904009 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:29.903974    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5887ffcbbc-bzjkn"]
Jul 29 19:17:29.952858 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:29.952825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:30.032200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.032171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:30.050103 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.050074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-service-ca\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.050103 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.050111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-trusted-ca-bundle\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.050291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.050143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-config\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.050291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.050174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-oauth-serving-cert\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.050291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.050200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l95j7\" (UniqueName: \"kubernetes.io/projected/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-kube-api-access-l95j7\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.050291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.050230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-serving-cert\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.050291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.050264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-oauth-config\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-config\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-oauth-serving-cert\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l95j7\" (UniqueName: \"kubernetes.io/projected/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-kube-api-access-l95j7\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151367 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-serving-cert\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151367 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-oauth-config\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151483 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-service-ca\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151483 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-trusted-ca-bundle\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.151989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-oauth-serving-cert\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.152083 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.151967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-config\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.152083 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.152050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-service-ca\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.152217 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.152197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-trusted-ca-bundle\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.153706 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.153685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-oauth-config\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.153784 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.153773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-serving-cert\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.160134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.160112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l95j7\" (UniqueName: \"kubernetes.io/projected/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-kube-api-access-l95j7\") pod \"console-5887ffcbbc-bzjkn\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") " pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.198196 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.198156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:30.332642 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:30.332608    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5887ffcbbc-bzjkn"]
Jul 29 19:17:30.335627 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:17:30.335598    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0ada0d_6dff_4f86_a5b2_1b319840eeaf.slice/crio-dd0b3a2dc453cca22e289d19d648ca3b9d4200fab80d7b5aad757a0508f5a91e WatchSource:0}: Error finding container dd0b3a2dc453cca22e289d19d648ca3b9d4200fab80d7b5aad757a0508f5a91e: Status 404 returned error can't find the container with id dd0b3a2dc453cca22e289d19d648ca3b9d4200fab80d7b5aad757a0508f5a91e
Jul 29 19:17:31.311881 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:31.311843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887ffcbbc-bzjkn" event={"ID":"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf","Type":"ContainerStarted","Data":"d602e6d435d2adbbaa6458b3a54cd216de28c2848af89943edd0887d20b2e968"}
Jul 29 19:17:31.312360 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:31.311899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887ffcbbc-bzjkn" event={"ID":"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf","Type":"ContainerStarted","Data":"dd0b3a2dc453cca22e289d19d648ca3b9d4200fab80d7b5aad757a0508f5a91e"}
Jul 29 19:17:31.332707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:31.332646    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5887ffcbbc-bzjkn" podStartSLOduration=2.332625256 podStartE2EDuration="2.332625256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:31.330616664 +0000 UTC m=+145.226433933" watchObservedRunningTime="2026-07-29 19:17:31.332625256 +0000 UTC m=+145.228442525"
Jul 29 19:17:39.443331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:39.443293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:39.524165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:39.524128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:40.199170 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.199128    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:40.199363 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.199186    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:40.204000 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.203974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:40.347729 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.347698    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:17:40.396169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.396137    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4fdd6766-hdbrb"]
Jul 29 19:17:40.503101 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.503078    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:40.603692 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.603653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:40.669658 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:40.669625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:54.200239 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:54.200198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:54.479754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:17:54.479674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:01.672444 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:01.672367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:05.418128 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.418064    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b4fdd6766-hdbrb" podUID="a8274826-5f38-477c-8374-2e1a9935956e" containerName="console" containerID="cri-o://4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a" gracePeriod=15
Jul 29 19:18:05.656975 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.656947    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:18:05.730172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-console-config\") pod \"a8274826-5f38-477c-8374-2e1a9935956e\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") "
Jul 29 19:18:05.730172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730115    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-service-ca\") pod \"a8274826-5f38-477c-8374-2e1a9935956e\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") "
Jul 29 19:18:05.730172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730140    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5jdd\" (UniqueName: \"kubernetes.io/projected/a8274826-5f38-477c-8374-2e1a9935956e-kube-api-access-q5jdd\") pod \"a8274826-5f38-477c-8374-2e1a9935956e\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") "
Jul 29 19:18:05.730172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730158    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-oauth-serving-cert\") pod \"a8274826-5f38-477c-8374-2e1a9935956e\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") "
Jul 29 19:18:05.730460 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730210    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-oauth-config\") pod \"a8274826-5f38-477c-8374-2e1a9935956e\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") "
Jul 29 19:18:05.730460 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730245    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-trusted-ca-bundle\") pod \"a8274826-5f38-477c-8374-2e1a9935956e\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") "
Jul 29 19:18:05.730460 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-serving-cert\") pod \"a8274826-5f38-477c-8374-2e1a9935956e\" (UID: \"a8274826-5f38-477c-8374-2e1a9935956e\") "
Jul 29 19:18:05.730648 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730485    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8274826-5f38-477c-8374-2e1a9935956e" (UID: "a8274826-5f38-477c-8374-2e1a9935956e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:18:05.730748 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730721    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8274826-5f38-477c-8374-2e1a9935956e" (UID: "a8274826-5f38-477c-8374-2e1a9935956e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:18:05.730857 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730758    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-console-config" (OuterVolumeSpecName: "console-config") pod "a8274826-5f38-477c-8374-2e1a9935956e" (UID: "a8274826-5f38-477c-8374-2e1a9935956e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:18:05.730857 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.730765    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8274826-5f38-477c-8374-2e1a9935956e" (UID: "a8274826-5f38-477c-8374-2e1a9935956e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:18:05.732305 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.732273    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8274826-5f38-477c-8374-2e1a9935956e-kube-api-access-q5jdd" (OuterVolumeSpecName: "kube-api-access-q5jdd") pod "a8274826-5f38-477c-8374-2e1a9935956e" (UID: "a8274826-5f38-477c-8374-2e1a9935956e"). InnerVolumeSpecName "kube-api-access-q5jdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:18:05.732422 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.732406    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8274826-5f38-477c-8374-2e1a9935956e" (UID: "a8274826-5f38-477c-8374-2e1a9935956e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:18:05.732482 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.732430    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8274826-5f38-477c-8374-2e1a9935956e" (UID: "a8274826-5f38-477c-8374-2e1a9935956e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:18:05.831661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.831621    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-console-config\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:05.831661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.831650    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:05.831661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.831659    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5jdd\" (UniqueName: \"kubernetes.io/projected/a8274826-5f38-477c-8374-2e1a9935956e-kube-api-access-q5jdd\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:05.831661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.831667    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-oauth-serving-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:05.831661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.831676    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-oauth-config\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:05.831946 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.831684    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274826-5f38-477c-8374-2e1a9935956e-trusted-ca-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:05.831946 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:05.831692    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274826-5f38-477c-8374-2e1a9935956e-console-serving-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:06.431837 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.431798    2576 generic.go:356] "Generic (PLEG): container finished" podID="a8274826-5f38-477c-8374-2e1a9935956e" containerID="4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a" exitCode=0
Jul 29 19:18:06.432223 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.431846    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fdd6766-hdbrb"
Jul 29 19:18:06.432223 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.431858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fdd6766-hdbrb" event={"ID":"a8274826-5f38-477c-8374-2e1a9935956e","Type":"ContainerDied","Data":"4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a"}
Jul 29 19:18:06.432223 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.431911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fdd6766-hdbrb" event={"ID":"a8274826-5f38-477c-8374-2e1a9935956e","Type":"ContainerDied","Data":"53f55ebfeff6080f3c159bd6a7856ddb20073072244430bf8e0d0beee8e52b77"}
Jul 29 19:18:06.432223 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.431938    2576 scope.go:117] "RemoveContainer" containerID="4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a"
Jul 29 19:18:06.440020 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.439999    2576 scope.go:117] "RemoveContainer" containerID="4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a"
Jul 29 19:18:06.440280 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:18:06.440259    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a\": container with ID starting with 4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a not found: ID does not exist" containerID="4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a"
Jul 29 19:18:06.440337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.440290    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a"} err="failed to get container status \"4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a\": rpc error: code = NotFound desc = could not find container \"4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a\": container with ID starting with 4194ddfd31db5ffd30f3bdd7bc531249f46ac5012bea576c30b75e2b02c5160a not found: ID does not exist"
Jul 29 19:18:06.461054 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.461028    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4fdd6766-hdbrb"]
Jul 29 19:18:06.464713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.464690    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b4fdd6766-hdbrb"]
Jul 29 19:18:06.713421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:06.713333    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8274826-5f38-477c-8374-2e1a9935956e" path="/var/lib/kubelet/pods/a8274826-5f38-477c-8374-2e1a9935956e/volumes"
Jul 29 19:18:24.092722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:24.092690    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:27.505595 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:27.505536    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:27.595195 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:27.595160    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:28.396329 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.396297    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"]
Jul 29 19:18:28.396582 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.396568    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8274826-5f38-477c-8374-2e1a9935956e" containerName="console"
Jul 29 19:18:28.396630 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.396582    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8274826-5f38-477c-8374-2e1a9935956e" containerName="console"
Jul 29 19:18:28.396664 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.396654    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8274826-5f38-477c-8374-2e1a9935956e" containerName="console"
Jul 29 19:18:28.398733 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.398715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.401190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.401170    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 19:18:28.401907 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.401886    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x82fk\""
Jul 29 19:18:28.401907 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.401902    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 19:18:28.410869 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.410783    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"]
Jul 29 19:18:28.493991 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.493947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.493991 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.493993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knddz\" (UniqueName: \"kubernetes.io/projected/769d5128-90ba-4b84-a70c-a94019cb0eaa-kube-api-access-knddz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.494226 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.494030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.594679 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.594638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.595158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.594724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.595158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.594759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knddz\" (UniqueName: \"kubernetes.io/projected/769d5128-90ba-4b84-a70c-a94019cb0eaa-kube-api-access-knddz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.595158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.595008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.595158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.595040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.604866 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.604826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knddz\" (UniqueName: \"kubernetes.io/projected/769d5128-90ba-4b84-a70c-a94019cb0eaa-kube-api-access-knddz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.707878 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.707767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:28.837594 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:28.837558    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"]
Jul 29 19:18:28.840777 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:18:28.840747    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769d5128_90ba_4b84_a70c_a94019cb0eaa.slice/crio-f76f0ef670848e19729587ebf43c98203235d67b7e13431e4c18554bbf6b6d4d WatchSource:0}: Error finding container f76f0ef670848e19729587ebf43c98203235d67b7e13431e4c18554bbf6b6d4d: Status 404 returned error can't find the container with id f76f0ef670848e19729587ebf43c98203235d67b7e13431e4c18554bbf6b6d4d
Jul 29 19:18:29.514609 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:29.514575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g" event={"ID":"769d5128-90ba-4b84-a70c-a94019cb0eaa","Type":"ContainerStarted","Data":"f76f0ef670848e19729587ebf43c98203235d67b7e13431e4c18554bbf6b6d4d"}
Jul 29 19:18:36.543917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:36.543875    2576 generic.go:356] "Generic (PLEG): container finished" podID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerID="c2dd45aba405851e4de5376b8e821984b0ceddae09422efe50365b60f0422dc5" exitCode=0
Jul 29 19:18:36.544324 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:36.543947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g" event={"ID":"769d5128-90ba-4b84-a70c-a94019cb0eaa","Type":"ContainerDied","Data":"c2dd45aba405851e4de5376b8e821984b0ceddae09422efe50365b60f0422dc5"}
Jul 29 19:18:39.556753 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:39.556718    2576 generic.go:356] "Generic (PLEG): container finished" podID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerID="d33d3f7632406a97c74917e3823f4441fd223473a850b9d3bff94a2c23dcca6b" exitCode=0
Jul 29 19:18:39.557156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:39.556809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g" event={"ID":"769d5128-90ba-4b84-a70c-a94019cb0eaa","Type":"ContainerDied","Data":"d33d3f7632406a97c74917e3823f4441fd223473a850b9d3bff94a2c23dcca6b"}
Jul 29 19:18:47.587936 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:47.587894    2576 generic.go:356] "Generic (PLEG): container finished" podID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerID="81d183f3710e43d1fa14c6f69dfece968cc053cc13b339c5bcd5ba9be33b4e1f" exitCode=0
Jul 29 19:18:47.588350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:47.587977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g" event={"ID":"769d5128-90ba-4b84-a70c-a94019cb0eaa","Type":"ContainerDied","Data":"81d183f3710e43d1fa14c6f69dfece968cc053cc13b339c5bcd5ba9be33b4e1f"}
Jul 29 19:18:48.716395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.716371    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:48.877356 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.877257    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-bundle\") pod \"769d5128-90ba-4b84-a70c-a94019cb0eaa\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") "
Jul 29 19:18:48.877356 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.877318    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knddz\" (UniqueName: \"kubernetes.io/projected/769d5128-90ba-4b84-a70c-a94019cb0eaa-kube-api-access-knddz\") pod \"769d5128-90ba-4b84-a70c-a94019cb0eaa\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") "
Jul 29 19:18:48.877356 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.877353    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-util\") pod \"769d5128-90ba-4b84-a70c-a94019cb0eaa\" (UID: \"769d5128-90ba-4b84-a70c-a94019cb0eaa\") "
Jul 29 19:18:48.878007 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.877977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-bundle" (OuterVolumeSpecName: "bundle") pod "769d5128-90ba-4b84-a70c-a94019cb0eaa" (UID: "769d5128-90ba-4b84-a70c-a94019cb0eaa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:18:48.879518 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.879493    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/769d5128-90ba-4b84-a70c-a94019cb0eaa-kube-api-access-knddz" (OuterVolumeSpecName: "kube-api-access-knddz") pod "769d5128-90ba-4b84-a70c-a94019cb0eaa" (UID: "769d5128-90ba-4b84-a70c-a94019cb0eaa"). InnerVolumeSpecName "kube-api-access-knddz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:18:48.882928 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.882908    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-util" (OuterVolumeSpecName: "util") pod "769d5128-90ba-4b84-a70c-a94019cb0eaa" (UID: "769d5128-90ba-4b84-a70c-a94019cb0eaa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:18:48.978688 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.978646    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knddz\" (UniqueName: \"kubernetes.io/projected/769d5128-90ba-4b84-a70c-a94019cb0eaa-kube-api-access-knddz\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:48.978688 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.978680    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-util\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:48.978688 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:48.978690    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/769d5128-90ba-4b84-a70c-a94019cb0eaa-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:18:49.596265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:49.596230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g" event={"ID":"769d5128-90ba-4b84-a70c-a94019cb0eaa","Type":"ContainerDied","Data":"f76f0ef670848e19729587ebf43c98203235d67b7e13431e4c18554bbf6b6d4d"}
Jul 29 19:18:49.596454 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:49.596287    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gm27g"
Jul 29 19:18:49.596454 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:49.596290    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f76f0ef670848e19729587ebf43c98203235d67b7e13431e4c18554bbf6b6d4d"
Jul 29 19:18:54.834336 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:54.834301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:55.316528 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:55.316491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:57.057717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.057682    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"]
Jul 29 19:18:57.058142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.057947    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerName="pull"
Jul 29 19:18:57.058142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.057961    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerName="pull"
Jul 29 19:18:57.058142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.057974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerName="util"
Jul 29 19:18:57.058142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.057979    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerName="util"
Jul 29 19:18:57.058142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.058006    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerName="extract"
Jul 29 19:18:57.058142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.058016    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerName="extract"
Jul 29 19:18:57.058142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.058068    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="769d5128-90ba-4b84-a70c-a94019cb0eaa" containerName="extract"
Jul 29 19:18:57.069847 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.069811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.072490 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.072463    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:18:57.072490 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.072464    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-25xfg\""
Jul 29 19:18:57.072689 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.072677    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 19:18:57.078792 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.078772    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"]
Jul 29 19:18:57.241712 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.241670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hzf\" (UniqueName: \"kubernetes.io/projected/67bb130d-aebf-4219-ba35-034221ca627b-kube-api-access-55hzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-kwtwd\" (UID: \"67bb130d-aebf-4219-ba35-034221ca627b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.241904 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.241721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67bb130d-aebf-4219-ba35-034221ca627b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kwtwd\" (UID: \"67bb130d-aebf-4219-ba35-034221ca627b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.342911 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.342830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55hzf\" (UniqueName: \"kubernetes.io/projected/67bb130d-aebf-4219-ba35-034221ca627b-kube-api-access-55hzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-kwtwd\" (UID: \"67bb130d-aebf-4219-ba35-034221ca627b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.342911 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.342880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67bb130d-aebf-4219-ba35-034221ca627b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kwtwd\" (UID: \"67bb130d-aebf-4219-ba35-034221ca627b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.343237 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.343218    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67bb130d-aebf-4219-ba35-034221ca627b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kwtwd\" (UID: \"67bb130d-aebf-4219-ba35-034221ca627b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.353102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.353068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hzf\" (UniqueName: \"kubernetes.io/projected/67bb130d-aebf-4219-ba35-034221ca627b-kube-api-access-55hzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-kwtwd\" (UID: \"67bb130d-aebf-4219-ba35-034221ca627b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.379388 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.379348    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"
Jul 29 19:18:57.547771 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.547736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd"]
Jul 29 19:18:57.551511 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:18:57.551482    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bb130d_aebf_4219_ba35_034221ca627b.slice/crio-36b980f848692cd0609ec0aac07f17bd12e27c678c312c080101d236b9002813 WatchSource:0}: Error finding container 36b980f848692cd0609ec0aac07f17bd12e27c678c312c080101d236b9002813: Status 404 returned error can't find the container with id 36b980f848692cd0609ec0aac07f17bd12e27c678c312c080101d236b9002813
Jul 29 19:18:57.624735 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:57.624647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd" event={"ID":"67bb130d-aebf-4219-ba35-034221ca627b","Type":"ContainerStarted","Data":"36b980f848692cd0609ec0aac07f17bd12e27c678c312c080101d236b9002813"}
Jul 29 19:18:58.954601 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:58.954562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:59.043843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:59.043802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:59.634263 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:59.634230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd" event={"ID":"67bb130d-aebf-4219-ba35-034221ca627b","Type":"ContainerStarted","Data":"5b8c936c6b483a3d6c48a010977c174d9f1a98975a05f2dd2df9653e200f96bc"}
Jul 29 19:18:59.683458 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:18:59.683399    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kwtwd" podStartSLOduration=0.683578594 podStartE2EDuration="2.683383316s" totalImagesPullingTime="1.999804722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:59.680657283 +0000 UTC m=+233.576474554" watchObservedRunningTime="2026-07-29 19:18:59.683383316 +0000 UTC m=+233.579200585"
Jul 29 19:19:00.209021 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.208981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:00.335367 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.335309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:00.426212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.426168    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"]
Jul 29 19:19:00.428509 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.428486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.433251 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.433230    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 19:19:00.433388 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.433304    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 19:19:00.434109 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.434081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x82fk\""
Jul 29 19:19:00.461803 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.461724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"]
Jul 29 19:19:00.466257 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.466233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.466367 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.466271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rzl\" (UniqueName: \"kubernetes.io/projected/8f6040c1-ab20-42a6-b789-009130d8e907-kube-api-access-v6rzl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.466367 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.466307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.567362 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.567329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.567534 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.567384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.567534 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.567421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rzl\" (UniqueName: \"kubernetes.io/projected/8f6040c1-ab20-42a6-b789-009130d8e907-kube-api-access-v6rzl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.567845 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.567827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.567882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.567824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.585602 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.585572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rzl\" (UniqueName: \"kubernetes.io/projected/8f6040c1-ab20-42a6-b789-009130d8e907-kube-api-access-v6rzl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.737535 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.737447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:00.876067 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:00.876031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"]
Jul 29 19:19:00.881298 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:19:00.881262    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6040c1_ab20_42a6_b789_009130d8e907.slice/crio-83f747abd92a869c14ac72b4a9c4d11ec174fbc05dff52351b399b7ea6ac1e32 WatchSource:0}: Error finding container 83f747abd92a869c14ac72b4a9c4d11ec174fbc05dff52351b399b7ea6ac1e32: Status 404 returned error can't find the container with id 83f747abd92a869c14ac72b4a9c4d11ec174fbc05dff52351b399b7ea6ac1e32
Jul 29 19:19:01.222696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.222661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:01.317526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.317493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:01.539689 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.539658    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-62jpc"]
Jul 29 19:19:01.541752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.541735    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:01.544576 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.544558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-s9fxm\""
Jul 29 19:19:01.544935 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.544921    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 19:19:01.545368 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.545340    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 19:19:01.557921 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.557900    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-62jpc"]
Jul 29 19:19:01.573534 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.573506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/458897bc-1299-4d79-a196-cf12f056041c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-62jpc\" (UID: \"458897bc-1299-4d79-a196-cf12f056041c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:01.573693 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.573538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhv68\" (UniqueName: \"kubernetes.io/projected/458897bc-1299-4d79-a196-cf12f056041c-kube-api-access-nhv68\") pod \"cert-manager-webhook-6486ffd997-62jpc\" (UID: \"458897bc-1299-4d79-a196-cf12f056041c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:01.644390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.644358    2576 generic.go:356] "Generic (PLEG): container finished" podID="8f6040c1-ab20-42a6-b789-009130d8e907" containerID="7541e2adfa8eeb36f1ca1f1ced91fdfc9b3381b7d61bdb97ccb86112a6e84e0f" exitCode=0
Jul 29 19:19:01.644610 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.644395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d" event={"ID":"8f6040c1-ab20-42a6-b789-009130d8e907","Type":"ContainerDied","Data":"7541e2adfa8eeb36f1ca1f1ced91fdfc9b3381b7d61bdb97ccb86112a6e84e0f"}
Jul 29 19:19:01.644610 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.644444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d" event={"ID":"8f6040c1-ab20-42a6-b789-009130d8e907","Type":"ContainerStarted","Data":"83f747abd92a869c14ac72b4a9c4d11ec174fbc05dff52351b399b7ea6ac1e32"}
Jul 29 19:19:01.674583 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.674512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/458897bc-1299-4d79-a196-cf12f056041c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-62jpc\" (UID: \"458897bc-1299-4d79-a196-cf12f056041c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:01.674728 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.674592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhv68\" (UniqueName: \"kubernetes.io/projected/458897bc-1299-4d79-a196-cf12f056041c-kube-api-access-nhv68\") pod \"cert-manager-webhook-6486ffd997-62jpc\" (UID: \"458897bc-1299-4d79-a196-cf12f056041c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:01.688580 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.688532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/458897bc-1299-4d79-a196-cf12f056041c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-62jpc\" (UID: \"458897bc-1299-4d79-a196-cf12f056041c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:01.688698 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.688678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhv68\" (UniqueName: \"kubernetes.io/projected/458897bc-1299-4d79-a196-cf12f056041c-kube-api-access-nhv68\") pod \"cert-manager-webhook-6486ffd997-62jpc\" (UID: \"458897bc-1299-4d79-a196-cf12f056041c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:01.866149 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:01.866063    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:02.006238 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:02.006198    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-62jpc"]
Jul 29 19:19:02.010028 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:19:02.010001    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod458897bc_1299_4d79_a196_cf12f056041c.slice/crio-58c45f5d11766670a127b352417078b9de7333a11aea9c743adcec7967d169b2 WatchSource:0}: Error finding container 58c45f5d11766670a127b352417078b9de7333a11aea9c743adcec7967d169b2: Status 404 returned error can't find the container with id 58c45f5d11766670a127b352417078b9de7333a11aea9c743adcec7967d169b2
Jul 29 19:19:02.650237 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:02.650159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc" event={"ID":"458897bc-1299-4d79-a196-cf12f056041c","Type":"ContainerStarted","Data":"58c45f5d11766670a127b352417078b9de7333a11aea9c743adcec7967d169b2"}
Jul 29 19:19:03.454229 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:03.454178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:03.629443 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:03.629396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:05.476198 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:05.476159    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:05.590244 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:05.590214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:05.671791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:05.671749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc" event={"ID":"458897bc-1299-4d79-a196-cf12f056041c","Type":"ContainerStarted","Data":"951896ac84b4a70d4ba752565c8340bb92a1f718ea23ab351dbf3d60996d11d8"}
Jul 29 19:19:05.671996 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:05.671963    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:05.673754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:05.673730    2576 generic.go:356] "Generic (PLEG): container finished" podID="8f6040c1-ab20-42a6-b789-009130d8e907" containerID="ada3fd6fe7db69ece348968ab97e9ef4e254d50f90ebd4e27dbba8a6b7213497" exitCode=0
Jul 29 19:19:05.673849 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:05.673765    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d" event={"ID":"8f6040c1-ab20-42a6-b789-009130d8e907","Type":"ContainerDied","Data":"ada3fd6fe7db69ece348968ab97e9ef4e254d50f90ebd4e27dbba8a6b7213497"}
Jul 29 19:19:05.687934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:05.687883    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc" podStartSLOduration=1.8533565749999998 podStartE2EDuration="4.687866843s" totalImagesPullingTime="2.834510268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:05.686768067 +0000 UTC m=+239.582585337" watchObservedRunningTime="2026-07-29 19:19:05.687866843 +0000 UTC m=+239.583684112"
Jul 29 19:19:06.679917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:06.679879    2576 generic.go:356] "Generic (PLEG): container finished" podID="8f6040c1-ab20-42a6-b789-009130d8e907" containerID="41c20694d58a30910363e2fe5f333465b92d44b990a7532d7032e10276d6742c" exitCode=0
Jul 29 19:19:06.680325 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:06.679961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d" event={"ID":"8f6040c1-ab20-42a6-b789-009130d8e907","Type":"ContainerDied","Data":"41c20694d58a30910363e2fe5f333465b92d44b990a7532d7032e10276d6742c"}
Jul 29 19:19:07.808969 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.808945    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:07.820113 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.820089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-util\") pod \"8f6040c1-ab20-42a6-b789-009130d8e907\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") "
Jul 29 19:19:07.820229 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.820121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-bundle\") pod \"8f6040c1-ab20-42a6-b789-009130d8e907\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") "
Jul 29 19:19:07.820229 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.820161    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6rzl\" (UniqueName: \"kubernetes.io/projected/8f6040c1-ab20-42a6-b789-009130d8e907-kube-api-access-v6rzl\") pod \"8f6040c1-ab20-42a6-b789-009130d8e907\" (UID: \"8f6040c1-ab20-42a6-b789-009130d8e907\") "
Jul 29 19:19:07.820507 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.820486    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-bundle" (OuterVolumeSpecName: "bundle") pod "8f6040c1-ab20-42a6-b789-009130d8e907" (UID: "8f6040c1-ab20-42a6-b789-009130d8e907"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:19:07.822318 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.822293    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6040c1-ab20-42a6-b789-009130d8e907-kube-api-access-v6rzl" (OuterVolumeSpecName: "kube-api-access-v6rzl") pod "8f6040c1-ab20-42a6-b789-009130d8e907" (UID: "8f6040c1-ab20-42a6-b789-009130d8e907"). InnerVolumeSpecName "kube-api-access-v6rzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:19:07.824783 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.824755    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-util" (OuterVolumeSpecName: "util") pod "8f6040c1-ab20-42a6-b789-009130d8e907" (UID: "8f6040c1-ab20-42a6-b789-009130d8e907"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:19:07.921683 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.921645    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6rzl\" (UniqueName: \"kubernetes.io/projected/8f6040c1-ab20-42a6-b789-009130d8e907-kube-api-access-v6rzl\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:19:07.921683 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.921676    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-util\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:19:07.921683 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:07.921686    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f6040c1-ab20-42a6-b789-009130d8e907-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:19:08.689529 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:08.689501    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d"
Jul 29 19:19:08.689529 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:08.689514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjxs4d" event={"ID":"8f6040c1-ab20-42a6-b789-009130d8e907","Type":"ContainerDied","Data":"83f747abd92a869c14ac72b4a9c4d11ec174fbc05dff52351b399b7ea6ac1e32"}
Jul 29 19:19:08.689761 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:08.689586    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83f747abd92a869c14ac72b4a9c4d11ec174fbc05dff52351b399b7ea6ac1e32"
Jul 29 19:19:08.753256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:08.753220    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:08.860817 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:08.860780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:09.424586 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:09.424535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:09.825682 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:09.825651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:09.932348 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:09.932312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:11.682458 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:11.682427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-62jpc"
Jul 29 19:19:12.359843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.359806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:12.583608 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.583573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:12.687589 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.687485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:12.794213 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794182    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q4vrb"]
Jul 29 19:19:12.794451 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794440    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6040c1-ab20-42a6-b789-009130d8e907" containerName="util"
Jul 29 19:19:12.794493 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794453    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6040c1-ab20-42a6-b789-009130d8e907" containerName="util"
Jul 29 19:19:12.794493 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794468    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6040c1-ab20-42a6-b789-009130d8e907" containerName="extract"
Jul 29 19:19:12.794493 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794473    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6040c1-ab20-42a6-b789-009130d8e907" containerName="extract"
Jul 29 19:19:12.794493 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794491    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6040c1-ab20-42a6-b789-009130d8e907" containerName="pull"
Jul 29 19:19:12.794628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794496    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6040c1-ab20-42a6-b789-009130d8e907" containerName="pull"
Jul 29 19:19:12.794628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.794555    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6040c1-ab20-42a6-b789-009130d8e907" containerName="extract"
Jul 29 19:19:12.796333 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.796316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:12.798341 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.798325    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k4pw6\""
Jul 29 19:19:12.807723 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.807698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q4vrb"]
Jul 29 19:19:12.860037 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.859994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a658c6d-96dd-41a8-8f5a-7661e23ba939-bound-sa-token\") pod \"cert-manager-55b4d954d5-q4vrb\" (UID: \"5a658c6d-96dd-41a8-8f5a-7661e23ba939\") " pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:12.860216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.860097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj5d6\" (UniqueName: \"kubernetes.io/projected/5a658c6d-96dd-41a8-8f5a-7661e23ba939-kube-api-access-tj5d6\") pod \"cert-manager-55b4d954d5-q4vrb\" (UID: \"5a658c6d-96dd-41a8-8f5a-7661e23ba939\") " pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:12.961280 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.961185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj5d6\" (UniqueName: \"kubernetes.io/projected/5a658c6d-96dd-41a8-8f5a-7661e23ba939-kube-api-access-tj5d6\") pod \"cert-manager-55b4d954d5-q4vrb\" (UID: \"5a658c6d-96dd-41a8-8f5a-7661e23ba939\") " pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:12.961280 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.961241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a658c6d-96dd-41a8-8f5a-7661e23ba939-bound-sa-token\") pod \"cert-manager-55b4d954d5-q4vrb\" (UID: \"5a658c6d-96dd-41a8-8f5a-7661e23ba939\") " pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:12.971899 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.971875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a658c6d-96dd-41a8-8f5a-7661e23ba939-bound-sa-token\") pod \"cert-manager-55b4d954d5-q4vrb\" (UID: \"5a658c6d-96dd-41a8-8f5a-7661e23ba939\") " pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:12.971979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:12.971928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj5d6\" (UniqueName: \"kubernetes.io/projected/5a658c6d-96dd-41a8-8f5a-7661e23ba939-kube-api-access-tj5d6\") pod \"cert-manager-55b4d954d5-q4vrb\" (UID: \"5a658c6d-96dd-41a8-8f5a-7661e23ba939\") " pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:13.104848 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:13.104811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q4vrb"
Jul 29 19:19:13.236491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:13.236428    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q4vrb"]
Jul 29 19:19:13.239192 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:19:13.239162    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a658c6d_96dd_41a8_8f5a_7661e23ba939.slice/crio-05d66057cd7329feaee71ef33a373de74adcc010a17d3ab994cfd78aa36328cb WatchSource:0}: Error finding container 05d66057cd7329feaee71ef33a373de74adcc010a17d3ab994cfd78aa36328cb: Status 404 returned error can't find the container with id 05d66057cd7329feaee71ef33a373de74adcc010a17d3ab994cfd78aa36328cb
Jul 29 19:19:13.711354 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:13.711318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q4vrb" event={"ID":"5a658c6d-96dd-41a8-8f5a-7661e23ba939","Type":"ContainerStarted","Data":"fff7f4445519b327ab0af98812b1c8b355d820800cdda81d547351403184279c"}
Jul 29 19:19:13.711354 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:13.711357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q4vrb" event={"ID":"5a658c6d-96dd-41a8-8f5a-7661e23ba939","Type":"ContainerStarted","Data":"05d66057cd7329feaee71ef33a373de74adcc010a17d3ab994cfd78aa36328cb"}
Jul 29 19:19:13.734030 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:13.733976    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-q4vrb" podStartSLOduration=1.73395783 podStartE2EDuration="1.73395783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:13.731266663 +0000 UTC m=+247.627083931" watchObservedRunningTime="2026-07-29 19:19:13.73395783 +0000 UTC m=+247.629775098"
Jul 29 19:19:18.566853 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:18.566804    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:18.666477 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:18.666437    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:20.460206 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.460171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:20.543522 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.543488    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"]
Jul 29 19:19:20.546169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.546151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.549257 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.549233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 19:19:20.549388 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.549338    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x82fk\""
Jul 29 19:19:20.549388 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.549347    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 19:19:20.557780 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.557754    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"]
Jul 29 19:19:20.618819 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.618781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.618819 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.618815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.619070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.618847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnndx\" (UniqueName: \"kubernetes.io/projected/7630c94d-754c-4bc1-ba95-0020e12107fb-kube-api-access-pnndx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.719683 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.719593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.719683 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.719635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.719683 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.719664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnndx\" (UniqueName: \"kubernetes.io/projected/7630c94d-754c-4bc1-ba95-0020e12107fb-kube-api-access-pnndx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.719963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.719945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.720004 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.719987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.728261 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.728228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnndx\" (UniqueName: \"kubernetes.io/projected/7630c94d-754c-4bc1-ba95-0020e12107fb-kube-api-access-pnndx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.854702 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.854668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:20.987082 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:20.987055    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"]
Jul 29 19:19:20.989399 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:19:20.989375    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7630c94d_754c_4bc1_ba95_0020e12107fb.slice/crio-1a00265fc0d9e82ac328ac5101770f03c6def414cc682549493bff1292d3f61b WatchSource:0}: Error finding container 1a00265fc0d9e82ac328ac5101770f03c6def414cc682549493bff1292d3f61b: Status 404 returned error can't find the container with id 1a00265fc0d9e82ac328ac5101770f03c6def414cc682549493bff1292d3f61b
Jul 29 19:19:21.744802 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:21.744759    2576 generic.go:356] "Generic (PLEG): container finished" podID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerID="1a17a0606556f262c21d42de1b73eea98ce9df5a3c315eaafc30d8f288c59de2" exitCode=0
Jul 29 19:19:21.745137 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:21.744821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v" event={"ID":"7630c94d-754c-4bc1-ba95-0020e12107fb","Type":"ContainerDied","Data":"1a17a0606556f262c21d42de1b73eea98ce9df5a3c315eaafc30d8f288c59de2"}
Jul 29 19:19:21.745137 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:21.744872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v" event={"ID":"7630c94d-754c-4bc1-ba95-0020e12107fb","Type":"ContainerStarted","Data":"1a00265fc0d9e82ac328ac5101770f03c6def414cc682549493bff1292d3f61b"}
Jul 29 19:19:22.750734 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:22.750652    2576 generic.go:356] "Generic (PLEG): container finished" podID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerID="ef0c1b007789fe16c7803a1f51d47ae4d4f17529332fdfb7a0505dbbec17eee8" exitCode=0
Jul 29 19:19:22.751082 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:22.750745    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v" event={"ID":"7630c94d-754c-4bc1-ba95-0020e12107fb","Type":"ContainerDied","Data":"ef0c1b007789fe16c7803a1f51d47ae4d4f17529332fdfb7a0505dbbec17eee8"}
Jul 29 19:19:23.757106 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:23.757075    2576 generic.go:356] "Generic (PLEG): container finished" podID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerID="b323a0b3c4e57e02bfab2608591f9a6f9d04519f1b3b071ab155beed8efbb478" exitCode=0
Jul 29 19:19:23.757494 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:23.757163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v" event={"ID":"7630c94d-754c-4bc1-ba95-0020e12107fb","Type":"ContainerDied","Data":"b323a0b3c4e57e02bfab2608591f9a6f9d04519f1b3b071ab155beed8efbb478"}
Jul 29 19:19:24.888397 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:24.888370    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:24.950019 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:24.949982    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnndx\" (UniqueName: \"kubernetes.io/projected/7630c94d-754c-4bc1-ba95-0020e12107fb-kube-api-access-pnndx\") pod \"7630c94d-754c-4bc1-ba95-0020e12107fb\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") "
Jul 29 19:19:24.950195 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:24.950042    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-bundle\") pod \"7630c94d-754c-4bc1-ba95-0020e12107fb\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") "
Jul 29 19:19:24.950195 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:24.950060    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-util\") pod \"7630c94d-754c-4bc1-ba95-0020e12107fb\" (UID: \"7630c94d-754c-4bc1-ba95-0020e12107fb\") "
Jul 29 19:19:24.950746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:24.950712    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-bundle" (OuterVolumeSpecName: "bundle") pod "7630c94d-754c-4bc1-ba95-0020e12107fb" (UID: "7630c94d-754c-4bc1-ba95-0020e12107fb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:19:24.952224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:24.952189    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7630c94d-754c-4bc1-ba95-0020e12107fb-kube-api-access-pnndx" (OuterVolumeSpecName: "kube-api-access-pnndx") pod "7630c94d-754c-4bc1-ba95-0020e12107fb" (UID: "7630c94d-754c-4bc1-ba95-0020e12107fb"). InnerVolumeSpecName "kube-api-access-pnndx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:19:24.956095 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:24.956050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-util" (OuterVolumeSpecName: "util") pod "7630c94d-754c-4bc1-ba95-0020e12107fb" (UID: "7630c94d-754c-4bc1-ba95-0020e12107fb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:19:25.051008 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:25.050903    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:19:25.051008 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:25.050938    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7630c94d-754c-4bc1-ba95-0020e12107fb-util\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:19:25.051008 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:25.050954    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnndx\" (UniqueName: \"kubernetes.io/projected/7630c94d-754c-4bc1-ba95-0020e12107fb-kube-api-access-pnndx\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:19:25.767970 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:25.767935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v" event={"ID":"7630c94d-754c-4bc1-ba95-0020e12107fb","Type":"ContainerDied","Data":"1a00265fc0d9e82ac328ac5101770f03c6def414cc682549493bff1292d3f61b"}
Jul 29 19:19:25.768138 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:25.767989    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a00265fc0d9e82ac328ac5101770f03c6def414cc682549493bff1292d3f61b"
Jul 29 19:19:25.768138 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:25.767935    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbbt4v"
Jul 29 19:19:32.741975 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.741885    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:32.850713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.850670    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:32.851780 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.851759    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"]
Jul 29 19:19:32.852052 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.852041    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerName="pull"
Jul 29 19:19:32.852093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.852054    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerName="pull"
Jul 29 19:19:32.852093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.852065    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerName="extract"
Jul 29 19:19:32.852093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.852072    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerName="extract"
Jul 29 19:19:32.852093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.852086    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerName="util"
Jul 29 19:19:32.852093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.852091    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerName="util"
Jul 29 19:19:32.852236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.852135    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7630c94d-754c-4bc1-ba95-0020e12107fb" containerName="extract"
Jul 29 19:19:32.856091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.856071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:32.859769 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.859751    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 19:19:32.860437 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.860417    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zc5z7\""
Jul 29 19:19:32.860538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.860419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 19:19:32.860621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.860574    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:19:32.860738 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.860723    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 19:19:32.867621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.867602    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 19:19:32.868854 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.868832    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"]
Jul 29 19:19:32.912256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.912216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c0fdf74-5883-4a25-aa5e-6055d92daeec-cert\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:32.912256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.912258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c0fdf74-5883-4a25-aa5e-6055d92daeec-metrics-cert\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:32.912478 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.912278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg8cs\" (UniqueName: \"kubernetes.io/projected/3c0fdf74-5883-4a25-aa5e-6055d92daeec-kube-api-access-vg8cs\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:32.912478 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:32.912336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c0fdf74-5883-4a25-aa5e-6055d92daeec-manager-config\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.013606 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.013571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c0fdf74-5883-4a25-aa5e-6055d92daeec-cert\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.013769 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.013627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c0fdf74-5883-4a25-aa5e-6055d92daeec-metrics-cert\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.013769 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.013650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8cs\" (UniqueName: \"kubernetes.io/projected/3c0fdf74-5883-4a25-aa5e-6055d92daeec-kube-api-access-vg8cs\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.013769 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.013693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c0fdf74-5883-4a25-aa5e-6055d92daeec-manager-config\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.014418 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.014392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c0fdf74-5883-4a25-aa5e-6055d92daeec-manager-config\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.016033 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.016013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c0fdf74-5883-4a25-aa5e-6055d92daeec-metrics-cert\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.016210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.016189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c0fdf74-5883-4a25-aa5e-6055d92daeec-cert\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.030742 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.030711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8cs\" (UniqueName: \"kubernetes.io/projected/3c0fdf74-5883-4a25-aa5e-6055d92daeec-kube-api-access-vg8cs\") pod \"lws-controller-manager-66ff6dc8fc-96g8r\" (UID: \"3c0fdf74-5883-4a25-aa5e-6055d92daeec\") " pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.165423 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.165392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:33.313679 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.313654    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"]
Jul 29 19:19:33.316006 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:19:33.315976    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0fdf74_5883_4a25_aa5e_6055d92daeec.slice/crio-a7015cb10d88ea699f59fed78c580dabca2983900500e8060ad86776bed88a30 WatchSource:0}: Error finding container a7015cb10d88ea699f59fed78c580dabca2983900500e8060ad86776bed88a30: Status 404 returned error can't find the container with id a7015cb10d88ea699f59fed78c580dabca2983900500e8060ad86776bed88a30
Jul 29 19:19:33.803102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:33.803062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r" event={"ID":"3c0fdf74-5883-4a25-aa5e-6055d92daeec","Type":"ContainerStarted","Data":"a7015cb10d88ea699f59fed78c580dabca2983900500e8060ad86776bed88a30"}
Jul 29 19:19:35.711961 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:35.711925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:35.813457 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:35.813421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r" event={"ID":"3c0fdf74-5883-4a25-aa5e-6055d92daeec","Type":"ContainerStarted","Data":"d0d453a98055233541e5c5659ba1baa26dc7eadb2b0293af59ba07f38785c169"}
Jul 29 19:19:35.813654 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:35.813583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:35.865270 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:35.865213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r" podStartSLOduration=2.186332274 podStartE2EDuration="3.865193515s" totalImagesPullingTime="1.678861241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:35.86240522 +0000 UTC m=+269.758222489" watchObservedRunningTime="2026-07-29 19:19:35.865193515 +0000 UTC m=+269.761010784"
Jul 29 19:19:35.870002 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:35.869967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:36.304827 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.304782    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:36.572502 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.572404    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:36.676330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.676299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:36.760924 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.760888    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"]
Jul 29 19:19:36.802149 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.802111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"]
Jul 29 19:19:36.802331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.802210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.805717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.805695    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 19:19:36.806590 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.806557    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 19:19:36.806719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.806582    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 19:19:36.806719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.806583    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 19:19:36.808236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.808214    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-crltb\""
Jul 29 19:19:36.847044 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.846957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/392dd391-f6b6-43da-b3ae-4d7576f1694f-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.847044 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.847008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9g2\" (UniqueName: \"kubernetes.io/projected/392dd391-f6b6-43da-b3ae-4d7576f1694f-kube-api-access-9r9g2\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.847044 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.847030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/392dd391-f6b6-43da-b3ae-4d7576f1694f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.847287 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.847063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/392dd391-f6b6-43da-b3ae-4d7576f1694f-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.847287 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.847078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/392dd391-f6b6-43da-b3ae-4d7576f1694f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.948400 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.948355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9g2\" (UniqueName: \"kubernetes.io/projected/392dd391-f6b6-43da-b3ae-4d7576f1694f-kube-api-access-9r9g2\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.948400 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.948405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/392dd391-f6b6-43da-b3ae-4d7576f1694f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.948707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.948459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/392dd391-f6b6-43da-b3ae-4d7576f1694f-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.948707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.948481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/392dd391-f6b6-43da-b3ae-4d7576f1694f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.948707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.948538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/392dd391-f6b6-43da-b3ae-4d7576f1694f-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.948982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.948950    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/392dd391-f6b6-43da-b3ae-4d7576f1694f-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.950933 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.950912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/392dd391-f6b6-43da-b3ae-4d7576f1694f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.951237 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.951217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/392dd391-f6b6-43da-b3ae-4d7576f1694f-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.951349 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.951334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/392dd391-f6b6-43da-b3ae-4d7576f1694f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.960804 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.960771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9g2\" (UniqueName: \"kubernetes.io/projected/392dd391-f6b6-43da-b3ae-4d7576f1694f-kube-api-access-9r9g2\") pod \"opendatahub-operator-controller-manager-6f775ff5c-sdqjj\" (UID: \"392dd391-f6b6-43da-b3ae-4d7576f1694f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:36.997814 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:36.997778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:37.110572 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.110468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:37.112491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.112470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:37.208932 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.208901    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:37.276721 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.276695    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"]
Jul 29 19:19:37.279444 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:19:37.279414    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392dd391_f6b6_43da_b3ae_4d7576f1694f.slice/crio-25ba412899a880af74a059cfec6496b07ffa602b305968ba94a2561dbb3a8147 WatchSource:0}: Error finding container 25ba412899a880af74a059cfec6496b07ffa602b305968ba94a2561dbb3a8147: Status 404 returned error can't find the container with id 25ba412899a880af74a059cfec6496b07ffa602b305968ba94a2561dbb3a8147
Jul 29 19:19:37.308692 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.308664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:37.416080 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.415988    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:37.510358 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.510319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:37.729593 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.729491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:37.825236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.825197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj" event={"ID":"392dd391-f6b6-43da-b3ae-4d7576f1694f","Type":"ContainerStarted","Data":"25ba412899a880af74a059cfec6496b07ffa602b305968ba94a2561dbb3a8147"}
Jul 29 19:19:37.845563 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:37.845527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:40.840407 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:40.840369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj" event={"ID":"392dd391-f6b6-43da-b3ae-4d7576f1694f","Type":"ContainerStarted","Data":"95a1809e4aa748d435061882a6963b9a143cadb8476b809f85d7a02cc801455b"}
Jul 29 19:19:41.845855 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:41.845817    2576 generic.go:356] "Generic (PLEG): container finished" podID="392dd391-f6b6-43da-b3ae-4d7576f1694f" containerID="95a1809e4aa748d435061882a6963b9a143cadb8476b809f85d7a02cc801455b" exitCode=0
Jul 29 19:19:41.846306 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:41.845894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj" event={"ID":"392dd391-f6b6-43da-b3ae-4d7576f1694f","Type":"ContainerDied","Data":"95a1809e4aa748d435061882a6963b9a143cadb8476b809f85d7a02cc801455b"}
Jul 29 19:19:42.853379 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:42.853340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj" event={"ID":"392dd391-f6b6-43da-b3ae-4d7576f1694f","Type":"ContainerStarted","Data":"7be91a1248e2534e52474101424dc79e08aa2bc0d1a2048b0398fe534d4944cd"}
Jul 29 19:19:42.853894 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:42.853459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:42.925823 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:42.925763    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj" podStartSLOduration=2.670893511 podStartE2EDuration="6.925745983s" totalImagesPullingTime="3.190826391s" totalInitContainerRuntime="1.064026081s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:42.925042792 +0000 UTC m=+276.820860061" watchObservedRunningTime="2026-07-29 19:19:42.925745983 +0000 UTC m=+276.821563251"
Jul 29 19:19:44.290108 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:44.290072    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:44.369005 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:44.368964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:46.820043 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:46.820012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66ff6dc8fc-96g8r"
Jul 29 19:19:53.860287 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:53.860257    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-sdqjj"
Jul 29 19:19:56.394887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:56.394851    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:58.206321 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:58.206289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:58.320522 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:58.320491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:58.559209 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:19:58.559174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:06.525961 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:06.525927    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 19:20:08.524701 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:08.524663    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:08.651058 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:08.651007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:08.902402 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:08.902293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:09.013748 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:09.013700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:09.997971 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:09.997933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:10.794510 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.794478    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"]
Jul 29 19:20:10.800097 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.800081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.805587 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.805566    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 19:20:10.805747 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.805729    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 19:20:10.807389 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.807370    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 19:20:10.807494 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.807370    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 19:20:10.811948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.811926    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 19:20:10.812053 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.812008    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 19:20:10.812189 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.812173    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lcf4v\""
Jul 29 19:20:10.823272 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.823243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"]
Jul 29 19:20:10.830774 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.830746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfq65\" (UniqueName: \"kubernetes.io/projected/eab1a1e6-cd12-42c9-9218-5ca13216d26a-kube-api-access-tfq65\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.830919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.830783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab1a1e6-cd12-42c9-9218-5ca13216d26a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.830919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.830805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.830919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.830876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.831038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.830926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.831038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.830950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.831038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.830991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.931390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.931353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab1a1e6-cd12-42c9-9218-5ca13216d26a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.931390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.931390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.931628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.931412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.931628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.931529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.931628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.931594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.931628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.931627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.931808 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.931661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfq65\" (UniqueName: \"kubernetes.io/projected/eab1a1e6-cd12-42c9-9218-5ca13216d26a-kube-api-access-tfq65\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.932184 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.932157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.933958 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.933928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.934057 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.934043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.934116 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.934101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab1a1e6-cd12-42c9-9218-5ca13216d26a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.934396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.934377    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eab1a1e6-cd12-42c9-9218-5ca13216d26a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.951439 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.951413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab1a1e6-cd12-42c9-9218-5ca13216d26a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:10.951983 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:10.951961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfq65\" (UniqueName: \"kubernetes.io/projected/eab1a1e6-cd12-42c9-9218-5ca13216d26a-kube-api-access-tfq65\") pod \"istiod-openshift-gateway-5677ccb49b-6hl27\" (UID: \"eab1a1e6-cd12-42c9-9218-5ca13216d26a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:11.028747 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:11.028714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:11.109032 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:11.108937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:11.197330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:11.197293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:11.268102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:11.268075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"]
Jul 29 19:20:11.268658 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:20:11.268635    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab1a1e6_cd12_42c9_9218_5ca13216d26a.slice/crio-bdc31b3b64069282946609c9afe904f6e741176e2aaa524be440a270ba3d6370 WatchSource:0}: Error finding container bdc31b3b64069282946609c9afe904f6e741176e2aaa524be440a270ba3d6370: Status 404 returned error can't find the container with id bdc31b3b64069282946609c9afe904f6e741176e2aaa524be440a270ba3d6370
Jul 29 19:20:11.270751 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:11.270734    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:20:11.982064 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:11.982022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27" event={"ID":"eab1a1e6-cd12-42c9-9218-5ca13216d26a","Type":"ContainerStarted","Data":"bdc31b3b64069282946609c9afe904f6e741176e2aaa524be440a270ba3d6370"}
Jul 29 19:20:12.859815 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:12.859775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:15.263594 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:15.263530    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:20:15.263897 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:15.263627    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:20:16.005033 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:16.004995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27" event={"ID":"eab1a1e6-cd12-42c9-9218-5ca13216d26a","Type":"ContainerStarted","Data":"7b912259d19d7bf3d8d29c3ae36f7a6b44d509ee82a1b47a6edac80e5f665d9b"}
Jul 29 19:20:16.005216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:16.005063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:16.006931 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:16.006900    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-6hl27 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 19:20:16.007004 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:16.006962    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27" podUID="eab1a1e6-cd12-42c9-9218-5ca13216d26a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:20:16.036491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:16.036434    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27" podStartSLOduration=2.043989225 podStartE2EDuration="6.036418787s" totalImagesPullingTime="3.992429562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:16.033708223 +0000 UTC m=+309.929525494" watchObservedRunningTime="2026-07-29 19:20:16.036418787 +0000 UTC m=+309.932236055"
Jul 29 19:20:16.292446 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:16.292352    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:16.388672 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:16.388636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:17.010021 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:17.009990    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6hl27"
Jul 29 19:20:17.159050 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:17.159016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:18.200811 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:18.200766    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:18.288342 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:18.288305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:24.013801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:24.013765    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:24.746119 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:24.746085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:58.330312 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:58.330196    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:20:58.415877 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:20:58.415833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:12.195607 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.195565    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"]
Jul 29 19:21:12.197961 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.197943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.200328 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.200304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2wfx7\""
Jul 29 19:21:12.201168 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.201146    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 19:21:12.201168 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.201161    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 19:21:12.209311 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.209278    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"]
Jul 29 19:21:12.252979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.252940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.253169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.253072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.253169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.253102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2zh\" (UniqueName: \"kubernetes.io/projected/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-kube-api-access-fm2zh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.353865 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.353825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.353865 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.353865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2zh\" (UniqueName: \"kubernetes.io/projected/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-kube-api-access-fm2zh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.354064 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.353897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.354216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.354196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.354261 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.354216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.363119 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.363087    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2zh\" (UniqueName: \"kubernetes.io/projected/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-kube-api-access-fm2zh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.507445 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.507412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:12.641332 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.641306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"]
Jul 29 19:21:12.643984 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:21:12.643949    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d30499b_d13f_4f8f_89d9_e14d56fcee4b.slice/crio-9888db1a5d9606929f96241b4a684048b39acda93dbff69932facf140e0f7106 WatchSource:0}: Error finding container 9888db1a5d9606929f96241b4a684048b39acda93dbff69932facf140e0f7106: Status 404 returned error can't find the container with id 9888db1a5d9606929f96241b4a684048b39acda93dbff69932facf140e0f7106
Jul 29 19:21:12.791647 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.791565    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"]
Jul 29 19:21:12.794088 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.794072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.807140 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.807100    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"]
Jul 29 19:21:12.858717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.858672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz2nb\" (UniqueName: \"kubernetes.io/projected/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-kube-api-access-kz2nb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.858717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.858716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.858953 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.858781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.959902 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.959860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.960106 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.959926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz2nb\" (UniqueName: \"kubernetes.io/projected/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-kube-api-access-kz2nb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.960106 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.959952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.960295 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.960273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.960353 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.960305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:12.969660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:12.969635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz2nb\" (UniqueName: \"kubernetes.io/projected/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-kube-api-access-kz2nb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:13.113503 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.113417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:13.244847 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.244728    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"]
Jul 29 19:21:13.247627 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:21:13.247600    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16ee2f4_9daa_4a58_a165_ff5ce1c64f8c.slice/crio-d3c9405060ba525af88f3960f89e2d22e26fc1223fb43120b06405a13a923ee7 WatchSource:0}: Error finding container d3c9405060ba525af88f3960f89e2d22e26fc1223fb43120b06405a13a923ee7: Status 404 returned error can't find the container with id d3c9405060ba525af88f3960f89e2d22e26fc1223fb43120b06405a13a923ee7
Jul 29 19:21:13.250841 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.250814    2576 generic.go:356] "Generic (PLEG): container finished" podID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerID="3d4e0e5880aa2dd308ac48932a066e20c9da8cfde104a6f66d3b4c7d92372ae2" exitCode=0
Jul 29 19:21:13.250928 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.250894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk" event={"ID":"1d30499b-d13f-4f8f-89d9-e14d56fcee4b","Type":"ContainerDied","Data":"3d4e0e5880aa2dd308ac48932a066e20c9da8cfde104a6f66d3b4c7d92372ae2"}
Jul 29 19:21:13.250968 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.250943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk" event={"ID":"1d30499b-d13f-4f8f-89d9-e14d56fcee4b","Type":"ContainerStarted","Data":"9888db1a5d9606929f96241b4a684048b39acda93dbff69932facf140e0f7106"}
Jul 29 19:21:13.427352 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.427317    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"]
Jul 29 19:21:13.429600 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.429579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.452733 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.452698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"]
Jul 29 19:21:13.465261 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.465225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kw9w\" (UniqueName: \"kubernetes.io/projected/92002c08-7a73-42c7-8b87-a93283a40964-kube-api-access-7kw9w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.465447 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.465282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.465447 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.465307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.566081 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.566045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.566243 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.566211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kw9w\" (UniqueName: \"kubernetes.io/projected/92002c08-7a73-42c7-8b87-a93283a40964-kube-api-access-7kw9w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.566288 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.566274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.566447 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.566430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.566526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.566512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.575977 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.575951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kw9w\" (UniqueName: \"kubernetes.io/projected/92002c08-7a73-42c7-8b87-a93283a40964-kube-api-access-7kw9w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.739264 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.739186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:13.800475 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.800446    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"]
Jul 29 19:21:13.803389 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.803364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.820365 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.820330    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"]
Jul 29 19:21:13.868875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.868842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.869039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.868892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.869039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.868968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhm4t\" (UniqueName: \"kubernetes.io/projected/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-kube-api-access-zhm4t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.883962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.883881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"]
Jul 29 19:21:13.886209 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:21:13.886180    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92002c08_7a73_42c7_8b87_a93283a40964.slice/crio-3a2d46e3e15b0b36f32d0dd110c0eaed40cd7c131745227b830c7319ab3802ad WatchSource:0}: Error finding container 3a2d46e3e15b0b36f32d0dd110c0eaed40cd7c131745227b830c7319ab3802ad: Status 404 returned error can't find the container with id 3a2d46e3e15b0b36f32d0dd110c0eaed40cd7c131745227b830c7319ab3802ad
Jul 29 19:21:13.969618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.969583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.969778 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.969635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.969778 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.969693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhm4t\" (UniqueName: \"kubernetes.io/projected/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-kube-api-access-zhm4t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.969962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.969941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.970031 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.970006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:13.979383 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:13.979355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhm4t\" (UniqueName: \"kubernetes.io/projected/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-kube-api-access-zhm4t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:14.114212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.114177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:14.248254 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.248230    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"]
Jul 29 19:21:14.250327 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:21:14.250298    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7534e7_8ea5_4803_b721_7c8c5ba38df3.slice/crio-1e8df184117005f55973d4f7a33872cdadf7d4a3847f337adbfe3bf7cef13cc7 WatchSource:0}: Error finding container 1e8df184117005f55973d4f7a33872cdadf7d4a3847f337adbfe3bf7cef13cc7: Status 404 returned error can't find the container with id 1e8df184117005f55973d4f7a33872cdadf7d4a3847f337adbfe3bf7cef13cc7
Jul 29 19:21:14.257670 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.257641    2576 generic.go:356] "Generic (PLEG): container finished" podID="92002c08-7a73-42c7-8b87-a93283a40964" containerID="245975e6a8d856c28e9ae8f795b98b4ed068f18a9100210411ab0b3432117ee5" exitCode=0
Jul 29 19:21:14.257754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.257722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2" event={"ID":"92002c08-7a73-42c7-8b87-a93283a40964","Type":"ContainerDied","Data":"245975e6a8d856c28e9ae8f795b98b4ed068f18a9100210411ab0b3432117ee5"}
Jul 29 19:21:14.257794 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.257773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2" event={"ID":"92002c08-7a73-42c7-8b87-a93283a40964","Type":"ContainerStarted","Data":"3a2d46e3e15b0b36f32d0dd110c0eaed40cd7c131745227b830c7319ab3802ad"}
Jul 29 19:21:14.259759 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.259734    2576 generic.go:356] "Generic (PLEG): container finished" podID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerID="d83ff3e25e0280b58ae62dfcb2bd652cb46242b5cb4670f176445b000f2468f8" exitCode=0
Jul 29 19:21:14.259849 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.259794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk" event={"ID":"1d30499b-d13f-4f8f-89d9-e14d56fcee4b","Type":"ContainerDied","Data":"d83ff3e25e0280b58ae62dfcb2bd652cb46242b5cb4670f176445b000f2468f8"}
Jul 29 19:21:14.261409 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.261378    2576 generic.go:356] "Generic (PLEG): container finished" podID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerID="55a03b9ce5d8c55e887d7255efae9986916ec9d80ccfa638de7cc92e47900c7c" exitCode=0
Jul 29 19:21:14.261506 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.261489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9" event={"ID":"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c","Type":"ContainerDied","Data":"55a03b9ce5d8c55e887d7255efae9986916ec9d80ccfa638de7cc92e47900c7c"}
Jul 29 19:21:14.261598 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.261532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9" event={"ID":"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c","Type":"ContainerStarted","Data":"d3c9405060ba525af88f3960f89e2d22e26fc1223fb43120b06405a13a923ee7"}
Jul 29 19:21:14.262726 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:14.262707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk" event={"ID":"3b7534e7-8ea5-4803-b721-7c8c5ba38df3","Type":"ContainerStarted","Data":"1e8df184117005f55973d4f7a33872cdadf7d4a3847f337adbfe3bf7cef13cc7"}
Jul 29 19:21:15.269587 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:15.269523    2576 generic.go:356] "Generic (PLEG): container finished" podID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerID="9438f0ece4f7dcc0bb9d235180781a9430650772d13b4c9ba51f4a7eb6d39e1a" exitCode=0
Jul 29 19:21:15.269993 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:15.269619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk" event={"ID":"1d30499b-d13f-4f8f-89d9-e14d56fcee4b","Type":"ContainerDied","Data":"9438f0ece4f7dcc0bb9d235180781a9430650772d13b4c9ba51f4a7eb6d39e1a"}
Jul 29 19:21:15.271043 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:15.271021    2576 generic.go:356] "Generic (PLEG): container finished" podID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerID="c7a85654f361070579e644062cab14f529bf043d4e921e609f726cdec5fd6629" exitCode=0
Jul 29 19:21:15.271152 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:15.271106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk" event={"ID":"3b7534e7-8ea5-4803-b721-7c8c5ba38df3","Type":"ContainerDied","Data":"c7a85654f361070579e644062cab14f529bf043d4e921e609f726cdec5fd6629"}
Jul 29 19:21:15.273017 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:15.272979    2576 generic.go:356] "Generic (PLEG): container finished" podID="92002c08-7a73-42c7-8b87-a93283a40964" containerID="be7aa8c14e1ef0f1f10a937c624598bec698d7edd5b7327c441f026afdce991c" exitCode=0
Jul 29 19:21:15.273128 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:15.273068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2" event={"ID":"92002c08-7a73-42c7-8b87-a93283a40964","Type":"ContainerDied","Data":"be7aa8c14e1ef0f1f10a937c624598bec698d7edd5b7327c441f026afdce991c"}
Jul 29 19:21:16.280473 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.280437    2576 generic.go:356] "Generic (PLEG): container finished" podID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerID="a9bd44410791015d75b7e65bf95fe2c954d791359eac80cf767d2cee883016f8" exitCode=0
Jul 29 19:21:16.280930 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.280525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9" event={"ID":"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c","Type":"ContainerDied","Data":"a9bd44410791015d75b7e65bf95fe2c954d791359eac80cf767d2cee883016f8"}
Jul 29 19:21:16.282770 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.282746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk" event={"ID":"3b7534e7-8ea5-4803-b721-7c8c5ba38df3","Type":"ContainerStarted","Data":"49c0f4d4a82e9bdcc869b9f6da6f096339e509481de2a2f19a04255af342811f"}
Jul 29 19:21:16.285093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.285072    2576 generic.go:356] "Generic (PLEG): container finished" podID="92002c08-7a73-42c7-8b87-a93283a40964" containerID="50dd908faab6dd82fb06b23c9ef0c4605abd084417219deea5bd0d7ccdd1caca" exitCode=0
Jul 29 19:21:16.285198 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.285161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2" event={"ID":"92002c08-7a73-42c7-8b87-a93283a40964","Type":"ContainerDied","Data":"50dd908faab6dd82fb06b23c9ef0c4605abd084417219deea5bd0d7ccdd1caca"}
Jul 29 19:21:16.407000 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.406976    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:16.492905 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.492878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-util\") pod \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") "
Jul 29 19:21:16.493035 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.492927    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm2zh\" (UniqueName: \"kubernetes.io/projected/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-kube-api-access-fm2zh\") pod \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") "
Jul 29 19:21:16.493035 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.492981    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-bundle\") pod \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\" (UID: \"1d30499b-d13f-4f8f-89d9-e14d56fcee4b\") "
Jul 29 19:21:16.493515 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.493479    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-bundle" (OuterVolumeSpecName: "bundle") pod "1d30499b-d13f-4f8f-89d9-e14d56fcee4b" (UID: "1d30499b-d13f-4f8f-89d9-e14d56fcee4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:16.495101 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.495078    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-kube-api-access-fm2zh" (OuterVolumeSpecName: "kube-api-access-fm2zh") pod "1d30499b-d13f-4f8f-89d9-e14d56fcee4b" (UID: "1d30499b-d13f-4f8f-89d9-e14d56fcee4b"). InnerVolumeSpecName "kube-api-access-fm2zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:21:16.498442 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.498417    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-util" (OuterVolumeSpecName: "util") pod "1d30499b-d13f-4f8f-89d9-e14d56fcee4b" (UID: "1d30499b-d13f-4f8f-89d9-e14d56fcee4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:16.594005 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.593951    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm2zh\" (UniqueName: \"kubernetes.io/projected/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-kube-api-access-fm2zh\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:16.594005 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.593996    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:16.594005 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:16.594005    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d30499b-d13f-4f8f-89d9-e14d56fcee4b-util\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:17.292228 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.292200    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk"
Jul 29 19:21:17.292714 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.292195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk" event={"ID":"1d30499b-d13f-4f8f-89d9-e14d56fcee4b","Type":"ContainerDied","Data":"9888db1a5d9606929f96241b4a684048b39acda93dbff69932facf140e0f7106"}
Jul 29 19:21:17.292714 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.292324    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9888db1a5d9606929f96241b4a684048b39acda93dbff69932facf140e0f7106"
Jul 29 19:21:17.294631 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.294602    2576 generic.go:356] "Generic (PLEG): container finished" podID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerID="644ba88239078cdc4dfd63ca5f9765bc57f23f62cb67002465c59a6bb0228a66" exitCode=0
Jul 29 19:21:17.294796 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.294656    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9" event={"ID":"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c","Type":"ContainerDied","Data":"644ba88239078cdc4dfd63ca5f9765bc57f23f62cb67002465c59a6bb0228a66"}
Jul 29 19:21:17.296430 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.296402    2576 generic.go:356] "Generic (PLEG): container finished" podID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerID="49c0f4d4a82e9bdcc869b9f6da6f096339e509481de2a2f19a04255af342811f" exitCode=0
Jul 29 19:21:17.296536 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.296477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk" event={"ID":"3b7534e7-8ea5-4803-b721-7c8c5ba38df3","Type":"ContainerDied","Data":"49c0f4d4a82e9bdcc869b9f6da6f096339e509481de2a2f19a04255af342811f"}
Jul 29 19:21:17.454176 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.454145    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:17.502491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.502458    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-util\") pod \"92002c08-7a73-42c7-8b87-a93283a40964\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") "
Jul 29 19:21:17.502698 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.502523    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-bundle\") pod \"92002c08-7a73-42c7-8b87-a93283a40964\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") "
Jul 29 19:21:17.502698 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.502577    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kw9w\" (UniqueName: \"kubernetes.io/projected/92002c08-7a73-42c7-8b87-a93283a40964-kube-api-access-7kw9w\") pod \"92002c08-7a73-42c7-8b87-a93283a40964\" (UID: \"92002c08-7a73-42c7-8b87-a93283a40964\") "
Jul 29 19:21:17.503021 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.502995    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-bundle" (OuterVolumeSpecName: "bundle") pod "92002c08-7a73-42c7-8b87-a93283a40964" (UID: "92002c08-7a73-42c7-8b87-a93283a40964"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:17.504723 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.504701    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92002c08-7a73-42c7-8b87-a93283a40964-kube-api-access-7kw9w" (OuterVolumeSpecName: "kube-api-access-7kw9w") pod "92002c08-7a73-42c7-8b87-a93283a40964" (UID: "92002c08-7a73-42c7-8b87-a93283a40964"). InnerVolumeSpecName "kube-api-access-7kw9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:21:17.507991 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.507957    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-util" (OuterVolumeSpecName: "util") pod "92002c08-7a73-42c7-8b87-a93283a40964" (UID: "92002c08-7a73-42c7-8b87-a93283a40964"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:17.603396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.603301    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-util\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:17.603396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.603336    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92002c08-7a73-42c7-8b87-a93283a40964-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:17.603396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:17.603347    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kw9w\" (UniqueName: \"kubernetes.io/projected/92002c08-7a73-42c7-8b87-a93283a40964-kube-api-access-7kw9w\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:18.303051 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.303009    2576 generic.go:356] "Generic (PLEG): container finished" podID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerID="e60d85afa70620495b054eb75cd8c2c700a154bcaae6783b953cc4e03bed89b2" exitCode=0
Jul 29 19:21:18.303504 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.303101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk" event={"ID":"3b7534e7-8ea5-4803-b721-7c8c5ba38df3","Type":"ContainerDied","Data":"e60d85afa70620495b054eb75cd8c2c700a154bcaae6783b953cc4e03bed89b2"}
Jul 29 19:21:18.304987 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.304967    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2"
Jul 29 19:21:18.305112 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.305000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2" event={"ID":"92002c08-7a73-42c7-8b87-a93283a40964","Type":"ContainerDied","Data":"3a2d46e3e15b0b36f32d0dd110c0eaed40cd7c131745227b830c7319ab3802ad"}
Jul 29 19:21:18.305112 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.305045    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a2d46e3e15b0b36f32d0dd110c0eaed40cd7c131745227b830c7319ab3802ad"
Jul 29 19:21:18.431335 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.431308    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:18.510483 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.510445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz2nb\" (UniqueName: \"kubernetes.io/projected/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-kube-api-access-kz2nb\") pod \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") "
Jul 29 19:21:18.510719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.510500    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-bundle\") pod \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") "
Jul 29 19:21:18.510719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.510578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-util\") pod \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\" (UID: \"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c\") "
Jul 29 19:21:18.511003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.510975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-bundle" (OuterVolumeSpecName: "bundle") pod "b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" (UID: "b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:18.512876 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.512850    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-kube-api-access-kz2nb" (OuterVolumeSpecName: "kube-api-access-kz2nb") pod "b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" (UID: "b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c"). InnerVolumeSpecName "kube-api-access-kz2nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:21:18.516248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.516223    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-util" (OuterVolumeSpecName: "util") pod "b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" (UID: "b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:18.612061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.611967    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-util\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:18.612061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.612001    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz2nb\" (UniqueName: \"kubernetes.io/projected/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-kube-api-access-kz2nb\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:18.612061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:18.612015    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:19.312453 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.312424    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9"
Jul 29 19:21:19.312453 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.312432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9" event={"ID":"b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c","Type":"ContainerDied","Data":"d3c9405060ba525af88f3960f89e2d22e26fc1223fb43120b06405a13a923ee7"}
Jul 29 19:21:19.312964 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.312487    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3c9405060ba525af88f3960f89e2d22e26fc1223fb43120b06405a13a923ee7"
Jul 29 19:21:19.439270 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.439243    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:19.518539 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.518501    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-util\") pod \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") "
Jul 29 19:21:19.518539 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.518556    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhm4t\" (UniqueName: \"kubernetes.io/projected/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-kube-api-access-zhm4t\") pod \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") "
Jul 29 19:21:19.518791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.518626    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-bundle\") pod \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\" (UID: \"3b7534e7-8ea5-4803-b721-7c8c5ba38df3\") "
Jul 29 19:21:19.519274 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.519235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-bundle" (OuterVolumeSpecName: "bundle") pod "3b7534e7-8ea5-4803-b721-7c8c5ba38df3" (UID: "3b7534e7-8ea5-4803-b721-7c8c5ba38df3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:19.520739 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.520709    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-kube-api-access-zhm4t" (OuterVolumeSpecName: "kube-api-access-zhm4t") pod "3b7534e7-8ea5-4803-b721-7c8c5ba38df3" (UID: "3b7534e7-8ea5-4803-b721-7c8c5ba38df3"). InnerVolumeSpecName "kube-api-access-zhm4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:21:19.523906 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.523879    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-util" (OuterVolumeSpecName: "util") pod "3b7534e7-8ea5-4803-b721-7c8c5ba38df3" (UID: "3b7534e7-8ea5-4803-b721-7c8c5ba38df3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:21:19.619314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.619192    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-util\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:19.619314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.619249    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhm4t\" (UniqueName: \"kubernetes.io/projected/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-kube-api-access-zhm4t\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:19.619314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:19.619292    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b7534e7-8ea5-4803-b721-7c8c5ba38df3-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:21:20.319286 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:20.319261    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk"
Jul 29 19:21:20.319702 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:20.319252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk" event={"ID":"3b7534e7-8ea5-4803-b721-7c8c5ba38df3","Type":"ContainerDied","Data":"1e8df184117005f55973d4f7a33872cdadf7d4a3847f337adbfe3bf7cef13cc7"}
Jul 29 19:21:20.319702 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:20.319377    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e8df184117005f55973d4f7a33872cdadf7d4a3847f337adbfe3bf7cef13cc7"
Jul 29 19:21:29.118888 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:29.118810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:33.185076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:33.185037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:33.417279 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:33.417248    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:33.542837 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:33.542807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:33.930208 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:33.930111    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:34.041002 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:34.040971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:36.148786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:36.148723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:38.936484 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:38.936448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:41.137799 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:41.137765    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:41.406813 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:41.406706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:41.613169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:41.613134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:43.668398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:43.668362    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:44.283824 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:44.283786    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5887ffcbbc-bzjkn"]
Jul 29 19:21:44.453896 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:44.453857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:44.551710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:44.551601    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:44.656059 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:44.656027    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:44.871592 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:44.871477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:46.173347 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:46.173309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:46.268421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:46.268361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:47.169035 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:47.168970    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:47.306428 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:47.306395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:47.543354 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:47.543271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:47.756614 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:47.756569    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:49.686436 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:49.686397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:49.787918 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:49.787884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:57.372746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:57.372706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:57.476100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:57.476052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:21:58.227204 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227165    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"]
Jul 29 19:21:58.227659 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227643    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerName="extract"
Jul 29 19:21:58.227713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227663    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerName="extract"
Jul 29 19:21:58.227713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227679    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerName="extract"
Jul 29 19:21:58.227713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227688    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerName="extract"
Jul 29 19:21:58.227713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227702    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92002c08-7a73-42c7-8b87-a93283a40964" containerName="util"
Jul 29 19:21:58.227713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227710    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92002c08-7a73-42c7-8b87-a93283a40964" containerName="util"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227721    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227729    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227742    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerName="util"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227750    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerName="util"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227760    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227769    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227782    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerName="util"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227790    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerName="util"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227799    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92002c08-7a73-42c7-8b87-a93283a40964" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227808    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92002c08-7a73-42c7-8b87-a93283a40964" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227817    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227825    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerName="pull"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227840    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92002c08-7a73-42c7-8b87-a93283a40964" containerName="extract"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227848    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92002c08-7a73-42c7-8b87-a93283a40964" containerName="extract"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227858    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerName="extract"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227866    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerName="extract"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227877    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerName="util"
Jul 29 19:21:58.227909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227885    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerName="util"
Jul 29 19:21:58.228408 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227956    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c" containerName="extract"
Jul 29 19:21:58.228408 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227967    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d30499b-d13f-4f8f-89d9-e14d56fcee4b" containerName="extract"
Jul 29 19:21:58.228408 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227978    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92002c08-7a73-42c7-8b87-a93283a40964" containerName="extract"
Jul 29 19:21:58.228408 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.227988    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7534e7-8ea5-4803-b721-7c8c5ba38df3" containerName="extract"
Jul 29 19:21:58.230453 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.230434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"
Jul 29 19:21:58.232976 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.232953    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 19:21:58.233633 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.233614    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 19:21:58.233633 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.233619    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-npsrs\""
Jul 29 19:21:58.243875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.243854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5q8j\" (UniqueName: \"kubernetes.io/projected/48179430-6867-4c81-8e9a-1309ac0b0ca3-kube-api-access-w5q8j\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8nd\" (UID: \"48179430-6867-4c81-8e9a-1309ac0b0ca3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"
Jul 29 19:21:58.247928 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.247906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"]
Jul 29 19:21:58.345079 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.345036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q8j\" (UniqueName: \"kubernetes.io/projected/48179430-6867-4c81-8e9a-1309ac0b0ca3-kube-api-access-w5q8j\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8nd\" (UID: \"48179430-6867-4c81-8e9a-1309ac0b0ca3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"
Jul 29 19:21:58.357248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.357220    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5q8j\" (UniqueName: \"kubernetes.io/projected/48179430-6867-4c81-8e9a-1309ac0b0ca3-kube-api-access-w5q8j\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8nd\" (UID: \"48179430-6867-4c81-8e9a-1309ac0b0ca3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"
Jul 29 19:21:58.541523 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.541491    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"
Jul 29 19:21:58.680282 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:58.680255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"]
Jul 29 19:21:58.682193 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:21:58.682163    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48179430_6867_4c81_8e9a_1309ac0b0ca3.slice/crio-11d6e83401d7c9421918bb522b42f6512f9b6745e67cc580ce1b5c810a30f9d2 WatchSource:0}: Error finding container 11d6e83401d7c9421918bb522b42f6512f9b6745e67cc580ce1b5c810a30f9d2: Status 404 returned error can't find the container with id 11d6e83401d7c9421918bb522b42f6512f9b6745e67cc580ce1b5c810a30f9d2
Jul 29 19:21:59.503512 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:21:59.503437    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd" event={"ID":"48179430-6867-4c81-8e9a-1309ac0b0ca3","Type":"ContainerStarted","Data":"11d6e83401d7c9421918bb522b42f6512f9b6745e67cc580ce1b5c810a30f9d2"}
Jul 29 19:22:00.509639 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:00.509601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd" event={"ID":"48179430-6867-4c81-8e9a-1309ac0b0ca3","Type":"ContainerStarted","Data":"f2a69ae333d67038bd0a901531e4625c9ba5201a3ef181f90733d411b2440b06"}
Jul 29 19:22:00.510027 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:00.509706    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"
Jul 29 19:22:00.533404 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:00.533347    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd" podStartSLOduration=0.880274443 podStartE2EDuration="2.533330176s" totalImagesPullingTime="1.653055733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:00.530524302 +0000 UTC m=+414.426341570" watchObservedRunningTime="2026-07-29 19:22:00.533330176 +0000 UTC m=+414.429147517"
Jul 29 19:22:01.262813 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:01.262777    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:01.358334 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:01.358297    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:03.739137 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:03.739102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:03.848951 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:03.848912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:06.353018 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:06.352979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:06.466526 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:06.466491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:08.522472 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:08.522439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:08.624223 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:08.624189    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:09.303351 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.303290    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5887ffcbbc-bzjkn" podUID="6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" containerName="console" containerID="cri-o://d602e6d435d2adbbaa6458b3a54cd216de28c2848af89943edd0887d20b2e968" gracePeriod=15
Jul 29 19:22:09.553150 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.553123    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" containerID="d602e6d435d2adbbaa6458b3a54cd216de28c2848af89943edd0887d20b2e968" exitCode=0
Jul 29 19:22:09.553514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.553199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887ffcbbc-bzjkn" event={"ID":"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf","Type":"ContainerDied","Data":"d602e6d435d2adbbaa6458b3a54cd216de28c2848af89943edd0887d20b2e968"}
Jul 29 19:22:09.553514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.553246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887ffcbbc-bzjkn" event={"ID":"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf","Type":"ContainerDied","Data":"dd0b3a2dc453cca22e289d19d648ca3b9d4200fab80d7b5aad757a0508f5a91e"}
Jul 29 19:22:09.553514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.553261    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd0b3a2dc453cca22e289d19d648ca3b9d4200fab80d7b5aad757a0508f5a91e"
Jul 29 19:22:09.563922 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.563898    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:22:09.635774 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.635736    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-config\") pod \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") "
Jul 29 19:22:09.635774 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.635772    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-serving-cert\") pod \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") "
Jul 29 19:22:09.636003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.635803    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-trusted-ca-bundle\") pod \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") "
Jul 29 19:22:09.636003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.635839    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-oauth-config\") pod \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") "
Jul 29 19:22:09.636003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.635881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-service-ca\") pod \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") "
Jul 29 19:22:09.636003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.635931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-oauth-serving-cert\") pod \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") "
Jul 29 19:22:09.636003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.635955    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l95j7\" (UniqueName: \"kubernetes.io/projected/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-kube-api-access-l95j7\") pod \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\" (UID: \"6a0ada0d-6dff-4f86-a5b2-1b319840eeaf\") "
Jul 29 19:22:09.636245 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.636185    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-config" (OuterVolumeSpecName: "console-config") pod "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" (UID: "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:22:09.636366 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.636335    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" (UID: "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:22:09.636500 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.636358    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" (UID: "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:22:09.636500 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.636410    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" (UID: "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:22:09.638148 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.638117    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" (UID: "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:22:09.638270 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.638251    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" (UID: "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:22:09.638313 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.638250    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-kube-api-access-l95j7" (OuterVolumeSpecName: "kube-api-access-l95j7") pod "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" (UID: "6a0ada0d-6dff-4f86-a5b2-1b319840eeaf"). InnerVolumeSpecName "kube-api-access-l95j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:22:09.736974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.736935    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-config\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:09.736974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.736967    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-serving-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:09.736974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.736977    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-trusted-ca-bundle\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:09.736974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.736985    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-console-oauth-config\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:09.737231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.736994    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:09.737231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.737002    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-oauth-serving-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:09.737231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:09.737009    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l95j7\" (UniqueName: \"kubernetes.io/projected/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf-kube-api-access-l95j7\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:10.558279 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:10.558243    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887ffcbbc-bzjkn"
Jul 29 19:22:10.586744 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:10.586706    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5887ffcbbc-bzjkn"]
Jul 29 19:22:10.595087 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:10.595054    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5887ffcbbc-bzjkn"]
Jul 29 19:22:10.714474 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:10.714437    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" path="/var/lib/kubelet/pods/6a0ada0d-6dff-4f86-a5b2-1b319840eeaf/volumes"
Jul 29 19:22:11.517050 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:11.517023    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8nd"
Jul 29 19:22:15.101217 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:15.101185    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:15.185663 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:15.185625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:21.628065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:21.627975    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:21.728298 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:21.728260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:24.263293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:24.263259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:24.387464 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:24.387432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:26.863937 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:26.863896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:27.007625 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:27.007588    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:28.653661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:28.653577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:28.798703 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:28.798669    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:28.924800 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:28.924714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:29.590374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.590339    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z7r7n"]
Jul 29 19:22:29.590690 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.590676    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" containerName="console"
Jul 29 19:22:29.590690 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.590691    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" containerName="console"
Jul 29 19:22:29.590781 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.590733    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a0ada0d-6dff-4f86-a5b2-1b319840eeaf" containerName="console"
Jul 29 19:22:29.594712 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.594690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7r7n"
Jul 29 19:22:29.597260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.597240    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4tl97\""
Jul 29 19:22:29.602718 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.602571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7r7n"]
Jul 29 19:22:29.638241 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.638211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:29.694764 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.694725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8gjt\" (UniqueName: \"kubernetes.io/projected/8a073fee-0e30-4286-a3d5-ab2c334aaa01-kube-api-access-k8gjt\") pod \"authorino-58cd955675-z7r7n\" (UID: \"8a073fee-0e30-4286-a3d5-ab2c334aaa01\") " pod="kuadrant-system/authorino-58cd955675-z7r7n"
Jul 29 19:22:29.746260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.746227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:29.795326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.795292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8gjt\" (UniqueName: \"kubernetes.io/projected/8a073fee-0e30-4286-a3d5-ab2c334aaa01-kube-api-access-k8gjt\") pod \"authorino-58cd955675-z7r7n\" (UID: \"8a073fee-0e30-4286-a3d5-ab2c334aaa01\") " pod="kuadrant-system/authorino-58cd955675-z7r7n"
Jul 29 19:22:29.805737 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.805700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8gjt\" (UniqueName: \"kubernetes.io/projected/8a073fee-0e30-4286-a3d5-ab2c334aaa01-kube-api-access-k8gjt\") pod \"authorino-58cd955675-z7r7n\" (UID: \"8a073fee-0e30-4286-a3d5-ab2c334aaa01\") " pod="kuadrant-system/authorino-58cd955675-z7r7n"
Jul 29 19:22:29.904702 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:29.904609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7r7n"
Jul 29 19:22:30.044641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:30.044607    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7r7n"]
Jul 29 19:22:30.047460 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:22:30.047433    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a073fee_0e30_4286_a3d5_ab2c334aaa01.slice/crio-dedf41cce43817c0f5158a659d84459954027bb0b9172b73d4a2927aad1a3ea3 WatchSource:0}: Error finding container dedf41cce43817c0f5158a659d84459954027bb0b9172b73d4a2927aad1a3ea3: Status 404 returned error can't find the container with id dedf41cce43817c0f5158a659d84459954027bb0b9172b73d4a2927aad1a3ea3
Jul 29 19:22:30.657131 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:30.657097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7r7n" event={"ID":"8a073fee-0e30-4286-a3d5-ab2c334aaa01","Type":"ContainerStarted","Data":"dedf41cce43817c0f5158a659d84459954027bb0b9172b73d4a2927aad1a3ea3"}
Jul 29 19:22:33.674434 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:33.674383    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7r7n" event={"ID":"8a073fee-0e30-4286-a3d5-ab2c334aaa01","Type":"ContainerStarted","Data":"8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c"}
Jul 29 19:22:33.714326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:33.714269    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z7r7n" podStartSLOduration=1.698011652 podStartE2EDuration="4.714247267s" totalImagesPullingTime="3.016235615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:33.713043518 +0000 UTC m=+447.608860789" watchObservedRunningTime="2026-07-29 19:22:33.714247267 +0000 UTC m=+447.610064538"
Jul 29 19:22:33.766010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:33.765975    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7r7n"]
Jul 29 19:22:33.997167 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:33.997075    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:34.099988 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:34.099953    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:35.683930 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:35.683897    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z7r7n" podUID="8a073fee-0e30-4286-a3d5-ab2c334aaa01" containerName="authorino" containerID="cri-o://8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c" gracePeriod=30
Jul 29 19:22:35.920485 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:35.920461    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7r7n"
Jul 29 19:22:36.050253 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.050218    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8gjt\" (UniqueName: \"kubernetes.io/projected/8a073fee-0e30-4286-a3d5-ab2c334aaa01-kube-api-access-k8gjt\") pod \"8a073fee-0e30-4286-a3d5-ab2c334aaa01\" (UID: \"8a073fee-0e30-4286-a3d5-ab2c334aaa01\") "
Jul 29 19:22:36.052386 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.052357    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a073fee-0e30-4286-a3d5-ab2c334aaa01-kube-api-access-k8gjt" (OuterVolumeSpecName: "kube-api-access-k8gjt") pod "8a073fee-0e30-4286-a3d5-ab2c334aaa01" (UID: "8a073fee-0e30-4286-a3d5-ab2c334aaa01"). InnerVolumeSpecName "kube-api-access-k8gjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:22:36.150957 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.150905    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8gjt\" (UniqueName: \"kubernetes.io/projected/8a073fee-0e30-4286-a3d5-ab2c334aaa01-kube-api-access-k8gjt\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:22:36.688753 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.688722    2576 generic.go:356] "Generic (PLEG): container finished" podID="8a073fee-0e30-4286-a3d5-ab2c334aaa01" containerID="8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c" exitCode=0
Jul 29 19:22:36.689185 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.688762    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7r7n"
Jul 29 19:22:36.689185 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.688785    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7r7n" event={"ID":"8a073fee-0e30-4286-a3d5-ab2c334aaa01","Type":"ContainerDied","Data":"8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c"}
Jul 29 19:22:36.689185 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.688823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7r7n" event={"ID":"8a073fee-0e30-4286-a3d5-ab2c334aaa01","Type":"ContainerDied","Data":"dedf41cce43817c0f5158a659d84459954027bb0b9172b73d4a2927aad1a3ea3"}
Jul 29 19:22:36.689185 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.688841    2576 scope.go:117] "RemoveContainer" containerID="8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c"
Jul 29 19:22:36.697754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.697734    2576 scope.go:117] "RemoveContainer" containerID="8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c"
Jul 29 19:22:36.698024 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:22:36.698009    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c\": container with ID starting with 8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c not found: ID does not exist" containerID="8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c"
Jul 29 19:22:36.698066 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.698033    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c"} err="failed to get container status \"8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c\": rpc error: code = NotFound desc = could not find container \"8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c\": container with ID starting with 8db791f113dccfe82e0b299f164a5ececa8c4e1977d34436b57a8fe10152365c not found: ID does not exist"
Jul 29 19:22:36.722086 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.722051    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7r7n"]
Jul 29 19:22:36.722086 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:36.722087    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7r7n"]
Jul 29 19:22:38.656881 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:38.656848    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:38.714038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:38.714005    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a073fee-0e30-4286-a3d5-ab2c334aaa01" path="/var/lib/kubelet/pods/8a073fee-0e30-4286-a3d5-ab2c334aaa01/volumes"
Jul 29 19:22:38.726160 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:38.726130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:40.701115 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:40.701082    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:40.813006 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:40.812975    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:41.213034 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:41.212999    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:41.298424 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:41.298394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:49.841284 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:49.841233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:49.947114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:49.947071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:50.325113 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:50.325076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:54.017167 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:54.017128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:54.124085 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:22:54.124045    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:04.012324 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.012284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:04.118395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.118358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:04.503785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.503753    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78645dbb7b-klr2b"]
Jul 29 19:23:04.504114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.504097    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a073fee-0e30-4286-a3d5-ab2c334aaa01" containerName="authorino"
Jul 29 19:23:04.504191 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.504117    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a073fee-0e30-4286-a3d5-ab2c334aaa01" containerName="authorino"
Jul 29 19:23:04.504242 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.504212    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a073fee-0e30-4286-a3d5-ab2c334aaa01" containerName="authorino"
Jul 29 19:23:04.507020 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.506992    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78645dbb7b-klr2b"
Jul 29 19:23:04.510621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.510601    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4tl97\""
Jul 29 19:23:04.521206 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.521175    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78645dbb7b-klr2b"]
Jul 29 19:23:04.578941 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.578903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7t76\" (UniqueName: \"kubernetes.io/projected/f60cdf3d-648e-4a9d-a72e-439d405d3ab0-kube-api-access-s7t76\") pod \"authorino-78645dbb7b-klr2b\" (UID: \"f60cdf3d-648e-4a9d-a72e-439d405d3ab0\") " pod="kuadrant-system/authorino-78645dbb7b-klr2b"
Jul 29 19:23:04.604092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.604056    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78645dbb7b-klr2b"]
Jul 29 19:23:04.604350 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:23:04.604326    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-s7t76], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-78645dbb7b-klr2b" podUID="f60cdf3d-648e-4a9d-a72e-439d405d3ab0"
Jul 29 19:23:04.679682 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.679644    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7t76\" (UniqueName: \"kubernetes.io/projected/f60cdf3d-648e-4a9d-a72e-439d405d3ab0-kube-api-access-s7t76\") pod \"authorino-78645dbb7b-klr2b\" (UID: \"f60cdf3d-648e-4a9d-a72e-439d405d3ab0\") " pod="kuadrant-system/authorino-78645dbb7b-klr2b"
Jul 29 19:23:04.688961 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.688928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7t76\" (UniqueName: \"kubernetes.io/projected/f60cdf3d-648e-4a9d-a72e-439d405d3ab0-kube-api-access-s7t76\") pod \"authorino-78645dbb7b-klr2b\" (UID: \"f60cdf3d-648e-4a9d-a72e-439d405d3ab0\") " pod="kuadrant-system/authorino-78645dbb7b-klr2b"
Jul 29 19:23:04.823534 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.823434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78645dbb7b-klr2b"
Jul 29 19:23:04.830477 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.830450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78645dbb7b-klr2b"
Jul 29 19:23:04.881472 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.881439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7t76\" (UniqueName: \"kubernetes.io/projected/f60cdf3d-648e-4a9d-a72e-439d405d3ab0-kube-api-access-s7t76\") pod \"f60cdf3d-648e-4a9d-a72e-439d405d3ab0\" (UID: \"f60cdf3d-648e-4a9d-a72e-439d405d3ab0\") "
Jul 29 19:23:04.883655 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.883627    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60cdf3d-648e-4a9d-a72e-439d405d3ab0-kube-api-access-s7t76" (OuterVolumeSpecName: "kube-api-access-s7t76") pod "f60cdf3d-648e-4a9d-a72e-439d405d3ab0" (UID: "f60cdf3d-648e-4a9d-a72e-439d405d3ab0"). InnerVolumeSpecName "kube-api-access-s7t76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:23:04.982044 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:04.982003    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7t76\" (UniqueName: \"kubernetes.io/projected/f60cdf3d-648e-4a9d-a72e-439d405d3ab0-kube-api-access-s7t76\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:23:05.828361 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:05.828326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78645dbb7b-klr2b"
Jul 29 19:23:05.879673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:05.879633    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78645dbb7b-klr2b"]
Jul 29 19:23:05.884233 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:05.884194    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78645dbb7b-klr2b"]
Jul 29 19:23:06.715621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:06.715589    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f60cdf3d-648e-4a9d-a72e-439d405d3ab0" path="/var/lib/kubelet/pods/f60cdf3d-648e-4a9d-a72e-439d405d3ab0/volumes"
Jul 29 19:23:10.577134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.577095    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:10.608508 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.608457    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ffb49dfb-5z85f"]
Jul 29 19:23:10.614452 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.614424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.619672 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.619641    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 19:23:10.619672 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.619660    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9sb4n\""
Jul 29 19:23:10.619887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.619647    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 19:23:10.624661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.624626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdwkb\" (UniqueName: \"kubernetes.io/projected/90c89eef-f26d-49b5-b703-720fb1284523-kube-api-access-vdwkb\") pod \"maas-controller-6ffb49dfb-5z85f\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") " pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.624808 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.624704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c89eef-f26d-49b5-b703-720fb1284523-webhook-cert\") pod \"maas-controller-6ffb49dfb-5z85f\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") " pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.625537 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.625512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ffb49dfb-5z85f"]
Jul 29 19:23:10.683590 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.683526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:10.725922 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.725886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdwkb\" (UniqueName: \"kubernetes.io/projected/90c89eef-f26d-49b5-b703-720fb1284523-kube-api-access-vdwkb\") pod \"maas-controller-6ffb49dfb-5z85f\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") " pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.726117 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.725939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c89eef-f26d-49b5-b703-720fb1284523-webhook-cert\") pod \"maas-controller-6ffb49dfb-5z85f\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") " pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.728376 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.728352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c89eef-f26d-49b5-b703-720fb1284523-webhook-cert\") pod \"maas-controller-6ffb49dfb-5z85f\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") " pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.735942 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.735921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdwkb\" (UniqueName: \"kubernetes.io/projected/90c89eef-f26d-49b5-b703-720fb1284523-kube-api-access-vdwkb\") pod \"maas-controller-6ffb49dfb-5z85f\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") " pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.773346 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.773307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:10.786905 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.786868    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6979b57c55-9z2r9"]
Jul 29 19:23:10.789260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.789243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:10.803378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.803350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6979b57c55-9z2r9"]
Jul 29 19:23:10.826941 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.826906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f82f316-1b36-4105-b2f9-0ecad38b83a2-webhook-cert\") pod \"maas-controller-6979b57c55-9z2r9\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") " pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:10.827128 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.826957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x229p\" (UniqueName: \"kubernetes.io/projected/3f82f316-1b36-4105-b2f9-0ecad38b83a2-kube-api-access-x229p\") pod \"maas-controller-6979b57c55-9z2r9\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") " pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:10.927369 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.927275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:10.927507 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.927424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f82f316-1b36-4105-b2f9-0ecad38b83a2-webhook-cert\") pod \"maas-controller-6979b57c55-9z2r9\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") " pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:10.927507 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.927459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x229p\" (UniqueName: \"kubernetes.io/projected/3f82f316-1b36-4105-b2f9-0ecad38b83a2-kube-api-access-x229p\") pod \"maas-controller-6979b57c55-9z2r9\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") " pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:10.930197 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.930172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f82f316-1b36-4105-b2f9-0ecad38b83a2-webhook-cert\") pod \"maas-controller-6979b57c55-9z2r9\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") " pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:10.937667 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:10.937646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x229p\" (UniqueName: \"kubernetes.io/projected/3f82f316-1b36-4105-b2f9-0ecad38b83a2-kube-api-access-x229p\") pod \"maas-controller-6979b57c55-9z2r9\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") " pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:11.066509 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:11.066484    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ffb49dfb-5z85f"]
Jul 29 19:23:11.068557 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:23:11.068522    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c89eef_f26d_49b5_b703_720fb1284523.slice/crio-183f58f43f9b61f1dc04091c990b0657bc6c9da26c6829a9bd0ddd586af853dc WatchSource:0}: Error finding container 183f58f43f9b61f1dc04091c990b0657bc6c9da26c6829a9bd0ddd586af853dc: Status 404 returned error can't find the container with id 183f58f43f9b61f1dc04091c990b0657bc6c9da26c6829a9bd0ddd586af853dc
Jul 29 19:23:11.099497 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:11.099457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:11.234854 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:11.234825    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6979b57c55-9z2r9"]
Jul 29 19:23:11.237121 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:23:11.237093    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f82f316_1b36_4105_b2f9_0ecad38b83a2.slice/crio-67debc9450c0269c14874a544ac4061133c220f853c9357cc100a71e9f87eead WatchSource:0}: Error finding container 67debc9450c0269c14874a544ac4061133c220f853c9357cc100a71e9f87eead: Status 404 returned error can't find the container with id 67debc9450c0269c14874a544ac4061133c220f853c9357cc100a71e9f87eead
Jul 29 19:23:11.859149 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:11.859094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-9z2r9" event={"ID":"3f82f316-1b36-4105-b2f9-0ecad38b83a2","Type":"ContainerStarted","Data":"67debc9450c0269c14874a544ac4061133c220f853c9357cc100a71e9f87eead"}
Jul 29 19:23:11.860733 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:11.860707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffb49dfb-5z85f" event={"ID":"90c89eef-f26d-49b5-b703-720fb1284523","Type":"ContainerStarted","Data":"183f58f43f9b61f1dc04091c990b0657bc6c9da26c6829a9bd0ddd586af853dc"}
Jul 29 19:23:13.501503 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:13.501443    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:13.644724 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:13.644635    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:13.873802 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:13.873764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-9z2r9" event={"ID":"3f82f316-1b36-4105-b2f9-0ecad38b83a2","Type":"ContainerStarted","Data":"0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509"}
Jul 29 19:23:13.873973 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:13.873836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:13.875381 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:13.875351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffb49dfb-5z85f" event={"ID":"90c89eef-f26d-49b5-b703-720fb1284523","Type":"ContainerStarted","Data":"2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8"}
Jul 29 19:23:13.875520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:13.875395    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:13.908012 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:13.907855    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6979b57c55-9z2r9" podStartSLOduration=1.851137185 podStartE2EDuration="3.907837932s" totalImagesPullingTime="2.056700747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:13.905045141 +0000 UTC m=+487.800862411" watchObservedRunningTime="2026-07-29 19:23:13.907837932 +0000 UTC m=+487.803655200"
Jul 29 19:23:24.882828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:24.882792    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:23:24.883346 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:24.882880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:24.909634 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:24.909585    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ffb49dfb-5z85f" podStartSLOduration=12.572064735 podStartE2EDuration="14.909527313s" totalImagesPullingTime="2.337462578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:13.9512442 +0000 UTC m=+487.847061470" watchObservedRunningTime="2026-07-29 19:23:24.909527313 +0000 UTC m=+498.805344582"
Jul 29 19:23:24.951583 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:24.951537    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ffb49dfb-5z85f"]
Jul 29 19:23:24.951752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:24.951729    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6ffb49dfb-5z85f" podUID="90c89eef-f26d-49b5-b703-720fb1284523" containerName="manager" containerID="cri-o://2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8" gracePeriod=30
Jul 29 19:23:25.192234 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.192209    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:25.241518 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.241486    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c89eef-f26d-49b5-b703-720fb1284523-webhook-cert\") pod \"90c89eef-f26d-49b5-b703-720fb1284523\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") "
Jul 29 19:23:25.241715 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.241573    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdwkb\" (UniqueName: \"kubernetes.io/projected/90c89eef-f26d-49b5-b703-720fb1284523-kube-api-access-vdwkb\") pod \"90c89eef-f26d-49b5-b703-720fb1284523\" (UID: \"90c89eef-f26d-49b5-b703-720fb1284523\") "
Jul 29 19:23:25.243744 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.243706    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90c89eef-f26d-49b5-b703-720fb1284523-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "90c89eef-f26d-49b5-b703-720fb1284523" (UID: "90c89eef-f26d-49b5-b703-720fb1284523"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:23:25.243852 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.243735    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c89eef-f26d-49b5-b703-720fb1284523-kube-api-access-vdwkb" (OuterVolumeSpecName: "kube-api-access-vdwkb") pod "90c89eef-f26d-49b5-b703-720fb1284523" (UID: "90c89eef-f26d-49b5-b703-720fb1284523"). InnerVolumeSpecName "kube-api-access-vdwkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:23:25.343083 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.343044    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdwkb\" (UniqueName: \"kubernetes.io/projected/90c89eef-f26d-49b5-b703-720fb1284523-kube-api-access-vdwkb\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:23:25.343083 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.343075    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c89eef-f26d-49b5-b703-720fb1284523-webhook-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:23:25.934667 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.934629    2576 generic.go:356] "Generic (PLEG): container finished" podID="90c89eef-f26d-49b5-b703-720fb1284523" containerID="2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8" exitCode=0
Jul 29 19:23:25.935064 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.934695    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffb49dfb-5z85f"
Jul 29 19:23:25.935064 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.934713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffb49dfb-5z85f" event={"ID":"90c89eef-f26d-49b5-b703-720fb1284523","Type":"ContainerDied","Data":"2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8"}
Jul 29 19:23:25.935064 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.934770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffb49dfb-5z85f" event={"ID":"90c89eef-f26d-49b5-b703-720fb1284523","Type":"ContainerDied","Data":"183f58f43f9b61f1dc04091c990b0657bc6c9da26c6829a9bd0ddd586af853dc"}
Jul 29 19:23:25.935064 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.934794    2576 scope.go:117] "RemoveContainer" containerID="2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8"
Jul 29 19:23:25.945710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.945671    2576 scope.go:117] "RemoveContainer" containerID="2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8"
Jul 29 19:23:25.946160 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:23:25.946138    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8\": container with ID starting with 2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8 not found: ID does not exist" containerID="2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8"
Jul 29 19:23:25.946226 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.946172    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8"} err="failed to get container status \"2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8\": rpc error: code = NotFound desc = could not find container \"2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8\": container with ID starting with 2bcf4b2861415d607197689a2c21ecb82567444362cff5b6d72125b1302dadf8 not found: ID does not exist"
Jul 29 19:23:25.958065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.958034    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ffb49dfb-5z85f"]
Jul 29 19:23:25.963579 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:25.963535    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ffb49dfb-5z85f"]
Jul 29 19:23:26.714615 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:26.714580    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c89eef-f26d-49b5-b703-720fb1284523" path="/var/lib/kubelet/pods/90c89eef-f26d-49b5-b703-720fb1284523/volumes"
Jul 29 19:23:29.944852 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:29.944813    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:43.806601 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:43.806536    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:43.951033 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:43.950988    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:44.510381 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.510337    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:44.670418 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.670368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:44.759099 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.759058    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"]
Jul 29 19:23:44.759456 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.759433    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c89eef-f26d-49b5-b703-720fb1284523" containerName="manager"
Jul 29 19:23:44.759584 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.759476    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c89eef-f26d-49b5-b703-720fb1284523" containerName="manager"
Jul 29 19:23:44.759584 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.759573    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c89eef-f26d-49b5-b703-720fb1284523" containerName="manager"
Jul 29 19:23:44.767939 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.767877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:44.771271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.771233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:23:44.771401 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.771316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bjg7f\""
Jul 29 19:23:44.771401 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.771324    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 19:23:44.771401 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.771323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 29 19:23:44.790307 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.790275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"]
Jul 29 19:23:44.905839 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.905801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8d406-cff9-4a09-8771-195300952f33-openshift-service-ca\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:44.906228 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.905860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8d406-cff9-4a09-8771-195300952f33-maas-api-tls\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:44.906228 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:44.905962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fklp8\" (UniqueName: \"kubernetes.io/projected/a1d8d406-cff9-4a09-8771-195300952f33-kube-api-access-fklp8\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.006933 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.006891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8d406-cff9-4a09-8771-195300952f33-maas-api-tls\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.007127 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.006952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fklp8\" (UniqueName: \"kubernetes.io/projected/a1d8d406-cff9-4a09-8771-195300952f33-kube-api-access-fklp8\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.007127 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.007003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8d406-cff9-4a09-8771-195300952f33-openshift-service-ca\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.007725 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.007706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8d406-cff9-4a09-8771-195300952f33-openshift-service-ca\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.009511 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.009468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8d406-cff9-4a09-8771-195300952f33-maas-api-tls\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.017190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.017154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fklp8\" (UniqueName: \"kubernetes.io/projected/a1d8d406-cff9-4a09-8771-195300952f33-kube-api-access-fklp8\") pod \"maas-api-745dff79d8-49d8p\" (UID: \"a1d8d406-cff9-4a09-8771-195300952f33\") " pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.078624 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.078507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:45.236011 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:23:45.235980    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d8d406_cff9_4a09_8771_195300952f33.slice/crio-82d00cc5ee44932e5eab48e0d8f41a077576e67830b4ceab3eabb5c2e9680783 WatchSource:0}: Error finding container 82d00cc5ee44932e5eab48e0d8f41a077576e67830b4ceab3eabb5c2e9680783: Status 404 returned error can't find the container with id 82d00cc5ee44932e5eab48e0d8f41a077576e67830b4ceab3eabb5c2e9680783
Jul 29 19:23:45.236184 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.236121    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"]
Jul 29 19:23:45.520105 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.520069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:45.615776 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.615714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:45.700649 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.700611    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"]
Jul 29 19:23:45.705711 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.705686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:45.710262 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.710241    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kjk5b\""
Jul 29 19:23:45.714061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.713983    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 19:23:45.721527 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.721489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"]
Jul 29 19:23:45.813776 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.813686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wtvv\" (UniqueName: \"kubernetes.io/projected/465c62ff-5ab4-4c1c-8c15-f49640ed3c91-kube-api-access-8wtvv\") pod \"payload-pre-processing-687dbb6cf6-wjddx\" (UID: \"465c62ff-5ab4-4c1c-8c15-f49640ed3c91\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:45.813776 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.813739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/465c62ff-5ab4-4c1c-8c15-f49640ed3c91-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-wjddx\" (UID: \"465c62ff-5ab4-4c1c-8c15-f49640ed3c91\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:45.914695 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.914651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/465c62ff-5ab4-4c1c-8c15-f49640ed3c91-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-wjddx\" (UID: \"465c62ff-5ab4-4c1c-8c15-f49640ed3c91\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:45.915239 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.914774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wtvv\" (UniqueName: \"kubernetes.io/projected/465c62ff-5ab4-4c1c-8c15-f49640ed3c91-kube-api-access-8wtvv\") pod \"payload-pre-processing-687dbb6cf6-wjddx\" (UID: \"465c62ff-5ab4-4c1c-8c15-f49640ed3c91\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:45.915460 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.915439    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/465c62ff-5ab4-4c1c-8c15-f49640ed3c91-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-wjddx\" (UID: \"465c62ff-5ab4-4c1c-8c15-f49640ed3c91\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:45.934940 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:45.934904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wtvv\" (UniqueName: \"kubernetes.io/projected/465c62ff-5ab4-4c1c-8c15-f49640ed3c91-kube-api-access-8wtvv\") pod \"payload-pre-processing-687dbb6cf6-wjddx\" (UID: \"465c62ff-5ab4-4c1c-8c15-f49640ed3c91\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:46.016256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:46.016167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:46.036310 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:46.036277    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p" event={"ID":"a1d8d406-cff9-4a09-8771-195300952f33","Type":"ContainerStarted","Data":"82d00cc5ee44932e5eab48e0d8f41a077576e67830b4ceab3eabb5c2e9680783"}
Jul 29 19:23:46.180448 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:46.180414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"]
Jul 29 19:23:46.182649 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:23:46.182615    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465c62ff_5ab4_4c1c_8c15_f49640ed3c91.slice/crio-24b6905fc0a9952483a08e1497f5fd503a8ba29444282afd5d35b6cf82c1d066 WatchSource:0}: Error finding container 24b6905fc0a9952483a08e1497f5fd503a8ba29444282afd5d35b6cf82c1d066: Status 404 returned error can't find the container with id 24b6905fc0a9952483a08e1497f5fd503a8ba29444282afd5d35b6cf82c1d066
Jul 29 19:23:47.046756 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:47.046713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p" event={"ID":"a1d8d406-cff9-4a09-8771-195300952f33","Type":"ContainerStarted","Data":"c2c7c8b7335be10d65fe9c5a974138f9d67cb9d69c937c57eacd5bd84f3c5207"}
Jul 29 19:23:47.047389 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:47.047370    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:47.049056 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:47.049002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx" event={"ID":"465c62ff-5ab4-4c1c-8c15-f49640ed3c91","Type":"ContainerStarted","Data":"24b6905fc0a9952483a08e1497f5fd503a8ba29444282afd5d35b6cf82c1d066"}
Jul 29 19:23:47.083350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:47.083282    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p" podStartSLOduration=1.470418128 podStartE2EDuration="3.083259594s" totalImagesPullingTime="1.612841466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:47.08117092 +0000 UTC m=+520.976988202" watchObservedRunningTime="2026-07-29 19:23:47.083259594 +0000 UTC m=+520.979076867"
Jul 29 19:23:48.056041 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:48.055997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx" event={"ID":"465c62ff-5ab4-4c1c-8c15-f49640ed3c91","Type":"ContainerStarted","Data":"8c8708b9a3a65a27bc74acab996b61e9e4c564ad8686421a805f93c2e6c3fc47"}
Jul 29 19:23:48.056574 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:48.056206    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:23:48.077188 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:48.077130    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx" podStartSLOduration=1.355137059 podStartE2EDuration="3.07711312s" totalImagesPullingTime="1.721976061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:48.075580079 +0000 UTC m=+521.971397350" watchObservedRunningTime="2026-07-29 19:23:48.07711312 +0000 UTC m=+521.972930388"
Jul 29 19:23:53.062208 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:53.062171    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-745dff79d8-49d8p"
Jul 29 19:23:54.100851 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:54.100816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:54.208713 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:54.208677    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:59.063596 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:23:59.063486    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wjddx"
Jul 29 19:24:06.560955 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:06.560921    2576 scope.go:117] "RemoveContainer" containerID="d602e6d435d2adbbaa6458b3a54cd216de28c2848af89943edd0887d20b2e968"
Jul 29 19:24:06.991449 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:06.991342    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"]
Jul 29 19:24:06.995642 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:06.995621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.001861 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.001730    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 19:24:07.002948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.002515    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 19:24:07.002948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.002650    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 19:24:07.002948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.002516    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pm4b4\""
Jul 29 19:24:07.012610 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.012574    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"]
Jul 29 19:24:07.052756 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.052709    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:24:07.081904 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.081860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.081904 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.081904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/139513b7-0b90-46db-8a58-76def07064b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.082118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.081932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pgp\" (UniqueName: \"kubernetes.io/projected/139513b7-0b90-46db-8a58-76def07064b5-kube-api-access-h7pgp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.082118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.082012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.082118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.082052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.082118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.082078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183328 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183328 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/139513b7-0b90-46db-8a58-76def07064b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183612 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pgp\" (UniqueName: \"kubernetes.io/projected/139513b7-0b90-46db-8a58-76def07064b5-kube-api-access-h7pgp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183612 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183612 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183612 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183865 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183924 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.183924 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.183887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.185820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.185794    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/139513b7-0b90-46db-8a58-76def07064b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.186061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.186043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/139513b7-0b90-46db-8a58-76def07064b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.194119 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.194093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pgp\" (UniqueName: \"kubernetes.io/projected/139513b7-0b90-46db-8a58-76def07064b5-kube-api-access-h7pgp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb\" (UID: \"139513b7-0b90-46db-8a58-76def07064b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.307418 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.307375    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:07.455513 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:07.455488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"]
Jul 29 19:24:07.457377 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:24:07.457350    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139513b7_0b90_46db_8a58_76def07064b5.slice/crio-663e721ef130e0cb6c7195beeaf723451470349e4837590c1b25ae9fe7e8252a WatchSource:0}: Error finding container 663e721ef130e0cb6c7195beeaf723451470349e4837590c1b25ae9fe7e8252a: Status 404 returned error can't find the container with id 663e721ef130e0cb6c7195beeaf723451470349e4837590c1b25ae9fe7e8252a
Jul 29 19:24:08.163422 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:08.163378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb" event={"ID":"139513b7-0b90-46db-8a58-76def07064b5","Type":"ContainerStarted","Data":"663e721ef130e0cb6c7195beeaf723451470349e4837590c1b25ae9fe7e8252a"}
Jul 29 19:24:09.170591 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:09.170526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb" event={"ID":"139513b7-0b90-46db-8a58-76def07064b5","Type":"ContainerStarted","Data":"1f36ef1be704af18c6bb3e8e2c59ef8af9c7fabac14975c8036ceda2b6491567"}
Jul 29 19:24:09.193124 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:09.193068    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb" podStartSLOduration=2.204506169 podStartE2EDuration="3.193050043s" totalImagesPullingTime="988.543874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:09.191753837 +0000 UTC m=+543.087571109" watchObservedRunningTime="2026-07-29 19:24:09.193050043 +0000 UTC m=+543.088867315"
Jul 29 19:24:17.308469 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:17.308425    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:17.308951 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:17.308489    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:17.321282 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:17.321255    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:18.225107 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:18.225076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb"
Jul 29 19:24:25.096800 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:25.096767    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:24:29.981592 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:29.981538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:24:39.448572 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.448375    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"]
Jul 29 19:24:39.453585 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.453528    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.456508 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.456482    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 29 19:24:39.465224 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.465192    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"]
Jul 29 19:24:39.484288 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.484244    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:24:39.553691 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.553649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.553868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.553700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.553868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.553727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.553868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.553814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.553868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.553864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/152467ff-c9c6-481e-a328-feec411fef94-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.554004 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.553930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqdkh\" (UniqueName: \"kubernetes.io/projected/152467ff-c9c6-481e-a328-feec411fef94-kube-api-access-zqdkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.654696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.654653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.654696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.654702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.654925 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.654730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.654925 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.654767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.654925 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.654806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/152467ff-c9c6-481e-a328-feec411fef94-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.654925 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.654853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdkh\" (UniqueName: \"kubernetes.io/projected/152467ff-c9c6-481e-a328-feec411fef94-kube-api-access-zqdkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.655146 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.655120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.655206 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.655155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.655244 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.655200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.657160 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.657133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/152467ff-c9c6-481e-a328-feec411fef94-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.657963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.657942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/152467ff-c9c6-481e-a328-feec411fef94-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.663846 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.663805    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqdkh\" (UniqueName: \"kubernetes.io/projected/152467ff-c9c6-481e-a328-feec411fef94-kube-api-access-zqdkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m\" (UID: \"152467ff-c9c6-481e-a328-feec411fef94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.768148 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.768109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:39.909605 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:39.909577    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"]
Jul 29 19:24:39.911520 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:24:39.911493    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152467ff_c9c6_481e_a328_feec411fef94.slice/crio-3be53cfa9747f23b313c235d550601281ca96b6c20e8df0c7b076bcf5e022b29 WatchSource:0}: Error finding container 3be53cfa9747f23b313c235d550601281ca96b6c20e8df0c7b076bcf5e022b29: Status 404 returned error can't find the container with id 3be53cfa9747f23b313c235d550601281ca96b6c20e8df0c7b076bcf5e022b29
Jul 29 19:24:40.325754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:40.325714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m" event={"ID":"152467ff-c9c6-481e-a328-feec411fef94","Type":"ContainerStarted","Data":"0288fe7cbbaaa83a2f1ce35d56fc04725e4519dc2d2b4a8edb358198e1b9a116"}
Jul 29 19:24:40.325929 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:40.325774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m" event={"ID":"152467ff-c9c6-481e-a328-feec411fef94","Type":"ContainerStarted","Data":"3be53cfa9747f23b313c235d550601281ca96b6c20e8df0c7b076bcf5e022b29"}
Jul 29 19:24:40.372790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:40.372724    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m" podStartSLOduration=1.1587675960000001 podStartE2EDuration="1.372702057s" totalImagesPullingTime="213.934461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:40.370289319 +0000 UTC m=+574.266106589" watchObservedRunningTime="2026-07-29 19:24:40.372702057 +0000 UTC m=+574.268519326"
Jul 29 19:24:42.870596 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:42.870515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:24:47.191697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:47.191666    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:24:49.768905 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:49.768865    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:49.769294 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:49.768934    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:49.781384 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:49.781354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:24:50.386317 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:24:50.386288    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m"
Jul 29 19:25:13.085562 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:25:13.085508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:25:40.068795 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:25:40.068717    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:26:12.629173 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:26:12.629130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:26:12.720829 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:26:12.720791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:26:13.801403 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:26:13.801343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:26:14.064611 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:26:14.064502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:26:22.795154 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:26:22.795118    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:26:51.685517 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:26:51.685444    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:26:51.787246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:26:51.787210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:27:00.246348 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.246262    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6979b57c55-9z2r9"]
Jul 29 19:27:00.246809 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.246478    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6979b57c55-9z2r9" podUID="3f82f316-1b36-4105-b2f9-0ecad38b83a2" containerName="manager" containerID="cri-o://0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509" gracePeriod=30
Jul 29 19:27:00.497975 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.497915    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:27:00.585907 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.585874    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f82f316-1b36-4105-b2f9-0ecad38b83a2-webhook-cert\") pod \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") "
Jul 29 19:27:00.586089 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.585981    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x229p\" (UniqueName: \"kubernetes.io/projected/3f82f316-1b36-4105-b2f9-0ecad38b83a2-kube-api-access-x229p\") pod \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\" (UID: \"3f82f316-1b36-4105-b2f9-0ecad38b83a2\") "
Jul 29 19:27:00.587947 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.587907    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f82f316-1b36-4105-b2f9-0ecad38b83a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3f82f316-1b36-4105-b2f9-0ecad38b83a2" (UID: "3f82f316-1b36-4105-b2f9-0ecad38b83a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:27:00.588062 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.588024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f82f316-1b36-4105-b2f9-0ecad38b83a2-kube-api-access-x229p" (OuterVolumeSpecName: "kube-api-access-x229p") pod "3f82f316-1b36-4105-b2f9-0ecad38b83a2" (UID: "3f82f316-1b36-4105-b2f9-0ecad38b83a2"). InnerVolumeSpecName "kube-api-access-x229p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:27:00.687381 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.687339    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f82f316-1b36-4105-b2f9-0ecad38b83a2-webhook-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:27:00.687381 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:00.687374    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x229p\" (UniqueName: \"kubernetes.io/projected/3f82f316-1b36-4105-b2f9-0ecad38b83a2-kube-api-access-x229p\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:27:01.005357 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.005320    2576 generic.go:356] "Generic (PLEG): container finished" podID="3f82f316-1b36-4105-b2f9-0ecad38b83a2" containerID="0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509" exitCode=0
Jul 29 19:27:01.005582 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.005368    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-9z2r9"
Jul 29 19:27:01.005582 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.005371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-9z2r9" event={"ID":"3f82f316-1b36-4105-b2f9-0ecad38b83a2","Type":"ContainerDied","Data":"0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509"}
Jul 29 19:27:01.005582 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.005500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-9z2r9" event={"ID":"3f82f316-1b36-4105-b2f9-0ecad38b83a2","Type":"ContainerDied","Data":"67debc9450c0269c14874a544ac4061133c220f853c9357cc100a71e9f87eead"}
Jul 29 19:27:01.005582 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.005530    2576 scope.go:117] "RemoveContainer" containerID="0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509"
Jul 29 19:27:01.014340 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.014321    2576 scope.go:117] "RemoveContainer" containerID="0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509"
Jul 29 19:27:01.014696 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:27:01.014660    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509\": container with ID starting with 0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509 not found: ID does not exist" containerID="0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509"
Jul 29 19:27:01.014772 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.014699    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509"} err="failed to get container status \"0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509\": rpc error: code = NotFound desc = could not find container \"0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509\": container with ID starting with 0d36a5984b45e28c6ed612dd2184c92d4298a5aa706546225f055aec1084d509 not found: ID does not exist"
Jul 29 19:27:01.024253 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.024214    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6979b57c55-9z2r9"]
Jul 29 19:27:01.026296 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:01.026268    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6979b57c55-9z2r9"]
Jul 29 19:27:02.714514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:27:02.714426    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f82f316-1b36-4105-b2f9-0ecad38b83a2" path="/var/lib/kubelet/pods/3f82f316-1b36-4105-b2f9-0ecad38b83a2/volumes"
Jul 29 19:28:01.806754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.806715    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6979b57c55-dpzrs"]
Jul 29 19:28:01.807236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.807039    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f82f316-1b36-4105-b2f9-0ecad38b83a2" containerName="manager"
Jul 29 19:28:01.807236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.807049    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f82f316-1b36-4105-b2f9-0ecad38b83a2" containerName="manager"
Jul 29 19:28:01.807236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.807105    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f82f316-1b36-4105-b2f9-0ecad38b83a2" containerName="manager"
Jul 29 19:28:01.809965 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.809948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:01.812962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.812939    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 19:28:01.813054 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.812938    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 19:28:01.813054 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.812942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9sb4n\""
Jul 29 19:28:01.818478 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.818455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6979b57c55-dpzrs"]
Jul 29 19:28:01.904662 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.904622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx5qb\" (UniqueName: \"kubernetes.io/projected/b7396c15-36d7-4bed-ad9a-324de645ec84-kube-api-access-tx5qb\") pod \"maas-controller-6979b57c55-dpzrs\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") " pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:01.904851 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:01.904688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7396c15-36d7-4bed-ad9a-324de645ec84-webhook-cert\") pod \"maas-controller-6979b57c55-dpzrs\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") " pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:02.006076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.006042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5qb\" (UniqueName: \"kubernetes.io/projected/b7396c15-36d7-4bed-ad9a-324de645ec84-kube-api-access-tx5qb\") pod \"maas-controller-6979b57c55-dpzrs\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") " pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:02.006247 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.006101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7396c15-36d7-4bed-ad9a-324de645ec84-webhook-cert\") pod \"maas-controller-6979b57c55-dpzrs\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") " pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:02.008485 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.008465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7396c15-36d7-4bed-ad9a-324de645ec84-webhook-cert\") pod \"maas-controller-6979b57c55-dpzrs\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") " pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:02.015018 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.014991    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx5qb\" (UniqueName: \"kubernetes.io/projected/b7396c15-36d7-4bed-ad9a-324de645ec84-kube-api-access-tx5qb\") pod \"maas-controller-6979b57c55-dpzrs\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") " pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:02.122056 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.121964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:02.257102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.257075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6979b57c55-dpzrs"]
Jul 29 19:28:02.258935 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:28:02.258909    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7396c15_36d7_4bed_ad9a_324de645ec84.slice/crio-dee51810d09c99622c339195796855b174783d0b90ded0301c3d8385f366d314 WatchSource:0}: Error finding container dee51810d09c99622c339195796855b174783d0b90ded0301c3d8385f366d314: Status 404 returned error can't find the container with id dee51810d09c99622c339195796855b174783d0b90ded0301c3d8385f366d314
Jul 29 19:28:02.260303 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.260285    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:28:02.301086 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:02.301056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-dpzrs" event={"ID":"b7396c15-36d7-4bed-ad9a-324de645ec84","Type":"ContainerStarted","Data":"dee51810d09c99622c339195796855b174783d0b90ded0301c3d8385f366d314"}
Jul 29 19:28:03.307399 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:03.307364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-dpzrs" event={"ID":"b7396c15-36d7-4bed-ad9a-324de645ec84","Type":"ContainerStarted","Data":"1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003"}
Jul 29 19:28:03.307875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:03.307437    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:03.325625 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:03.325536    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6979b57c55-dpzrs" podStartSLOduration=1.873901779 podStartE2EDuration="2.325516413s" totalImagesPullingTime="451.614634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:28:03.324970116 +0000 UTC m=+777.220787398" watchObservedRunningTime="2026-07-29 19:28:03.325516413 +0000 UTC m=+777.221333685"
Jul 29 19:28:14.317687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:14.317655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:18.867801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:18.867754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:28:18.955390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:18.955348    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6979b57c55-dpzrs"]
Jul 29 19:28:18.955677 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:18.955637    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6979b57c55-dpzrs" podUID="b7396c15-36d7-4bed-ad9a-324de645ec84" containerName="manager" containerID="cri-o://1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003" gracePeriod=30
Jul 29 19:28:19.198632 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.198607    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:19.243703 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.243667    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7396c15-36d7-4bed-ad9a-324de645ec84-webhook-cert\") pod \"b7396c15-36d7-4bed-ad9a-324de645ec84\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") "
Jul 29 19:28:19.243893 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.243760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx5qb\" (UniqueName: \"kubernetes.io/projected/b7396c15-36d7-4bed-ad9a-324de645ec84-kube-api-access-tx5qb\") pod \"b7396c15-36d7-4bed-ad9a-324de645ec84\" (UID: \"b7396c15-36d7-4bed-ad9a-324de645ec84\") "
Jul 29 19:28:19.245886 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.245854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7396c15-36d7-4bed-ad9a-324de645ec84-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b7396c15-36d7-4bed-ad9a-324de645ec84" (UID: "b7396c15-36d7-4bed-ad9a-324de645ec84"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:28:19.246017 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.245881    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7396c15-36d7-4bed-ad9a-324de645ec84-kube-api-access-tx5qb" (OuterVolumeSpecName: "kube-api-access-tx5qb") pod "b7396c15-36d7-4bed-ad9a-324de645ec84" (UID: "b7396c15-36d7-4bed-ad9a-324de645ec84"). InnerVolumeSpecName "kube-api-access-tx5qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:28:19.344361 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.344329    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7396c15-36d7-4bed-ad9a-324de645ec84-webhook-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:28:19.344361 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.344359    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx5qb\" (UniqueName: \"kubernetes.io/projected/b7396c15-36d7-4bed-ad9a-324de645ec84-kube-api-access-tx5qb\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:28:19.387194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.387110    2576 generic.go:356] "Generic (PLEG): container finished" podID="b7396c15-36d7-4bed-ad9a-324de645ec84" containerID="1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003" exitCode=0
Jul 29 19:28:19.387194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.387154    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-dpzrs"
Jul 29 19:28:19.387368 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.387195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-dpzrs" event={"ID":"b7396c15-36d7-4bed-ad9a-324de645ec84","Type":"ContainerDied","Data":"1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003"}
Jul 29 19:28:19.387368 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.387247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-dpzrs" event={"ID":"b7396c15-36d7-4bed-ad9a-324de645ec84","Type":"ContainerDied","Data":"dee51810d09c99622c339195796855b174783d0b90ded0301c3d8385f366d314"}
Jul 29 19:28:19.387368 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.387270    2576 scope.go:117] "RemoveContainer" containerID="1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003"
Jul 29 19:28:19.395946 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.395929    2576 scope.go:117] "RemoveContainer" containerID="1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003"
Jul 29 19:28:19.396182 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:28:19.396158    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003\": container with ID starting with 1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003 not found: ID does not exist" containerID="1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003"
Jul 29 19:28:19.396277 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.396186    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003"} err="failed to get container status \"1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003\": rpc error: code = NotFound desc = could not find container \"1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003\": container with ID starting with 1c5b956048946ea97ced09128e526ace16364c2179210d48c2a827d3ead0c003 not found: ID does not exist"
Jul 29 19:28:19.408253 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.408227    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6979b57c55-dpzrs"]
Jul 29 19:28:19.411759 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:19.411738    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6979b57c55-dpzrs"]
Jul 29 19:28:20.059363 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.059318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:28:20.174693 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.174648    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6979b57c55-6569p"]
Jul 29 19:28:20.175074 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.175055    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7396c15-36d7-4bed-ad9a-324de645ec84" containerName="manager"
Jul 29 19:28:20.175157 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.175076    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7396c15-36d7-4bed-ad9a-324de645ec84" containerName="manager"
Jul 29 19:28:20.175256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.175169    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7396c15-36d7-4bed-ad9a-324de645ec84" containerName="manager"
Jul 29 19:28:20.179451 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.179424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.181962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.181940    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 19:28:20.182651 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.182637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 19:28:20.182892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.182877    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9sb4n\""
Jul 29 19:28:20.187848 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.187824    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6979b57c55-6569p"]
Jul 29 19:28:20.252736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.252698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zrv4\" (UniqueName: \"kubernetes.io/projected/52198945-11c8-45f3-85be-af604b5b938f-kube-api-access-6zrv4\") pod \"maas-controller-6979b57c55-6569p\" (UID: \"52198945-11c8-45f3-85be-af604b5b938f\") " pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.252945 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.252754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52198945-11c8-45f3-85be-af604b5b938f-webhook-cert\") pod \"maas-controller-6979b57c55-6569p\" (UID: \"52198945-11c8-45f3-85be-af604b5b938f\") " pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.353578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.353464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrv4\" (UniqueName: \"kubernetes.io/projected/52198945-11c8-45f3-85be-af604b5b938f-kube-api-access-6zrv4\") pod \"maas-controller-6979b57c55-6569p\" (UID: \"52198945-11c8-45f3-85be-af604b5b938f\") " pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.353578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.353526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52198945-11c8-45f3-85be-af604b5b938f-webhook-cert\") pod \"maas-controller-6979b57c55-6569p\" (UID: \"52198945-11c8-45f3-85be-af604b5b938f\") " pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.355938 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.355919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52198945-11c8-45f3-85be-af604b5b938f-webhook-cert\") pod \"maas-controller-6979b57c55-6569p\" (UID: \"52198945-11c8-45f3-85be-af604b5b938f\") " pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.362353 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.362328    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zrv4\" (UniqueName: \"kubernetes.io/projected/52198945-11c8-45f3-85be-af604b5b938f-kube-api-access-6zrv4\") pod \"maas-controller-6979b57c55-6569p\" (UID: \"52198945-11c8-45f3-85be-af604b5b938f\") " pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.491955 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.491915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:20.624403 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.624379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6979b57c55-6569p"]
Jul 29 19:28:20.626628 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:28:20.626603    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52198945_11c8_45f3_85be_af604b5b938f.slice/crio-3da0bdb7f79326639c2392eebdb4a840f48eb99c86775e13e1d3c6fbe4a556f2 WatchSource:0}: Error finding container 3da0bdb7f79326639c2392eebdb4a840f48eb99c86775e13e1d3c6fbe4a556f2: Status 404 returned error can't find the container with id 3da0bdb7f79326639c2392eebdb4a840f48eb99c86775e13e1d3c6fbe4a556f2
Jul 29 19:28:20.716518 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:20.716481    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7396c15-36d7-4bed-ad9a-324de645ec84" path="/var/lib/kubelet/pods/b7396c15-36d7-4bed-ad9a-324de645ec84/volumes"
Jul 29 19:28:21.399977 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:21.399889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-6569p" event={"ID":"52198945-11c8-45f3-85be-af604b5b938f","Type":"ContainerStarted","Data":"83ce5387becb10284813dc1bc459f6331623ab2a6bccf7eb1904a521c93628c3"}
Jul 29 19:28:21.399977 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:21.399947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6979b57c55-6569p" event={"ID":"52198945-11c8-45f3-85be-af604b5b938f","Type":"ContainerStarted","Data":"3da0bdb7f79326639c2392eebdb4a840f48eb99c86775e13e1d3c6fbe4a556f2"}
Jul 29 19:28:21.400401 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:21.400021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:21.417443 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:21.417384    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6979b57c55-6569p" podStartSLOduration=0.916415616 podStartE2EDuration="1.417366033s" totalImagesPullingTime="500.950417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:28:21.416035434 +0000 UTC m=+795.311852712" watchObservedRunningTime="2026-07-29 19:28:21.417366033 +0000 UTC m=+795.313183303"
Jul 29 19:28:32.407998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:32.407920    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6979b57c55-6569p"
Jul 29 19:28:54.854077 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:54.854046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:28:54.953525 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:54.953486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:28:55.087518 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:55.087486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:28:58.308238 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:28:58.308199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:00.934642 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:29:00.934609    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:01.037436 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:29:01.037398    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:01.134599 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:29:01.134568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:01.270196 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:29:01.270165    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:07.183146 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:29:07.183105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:07.261375 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:29:07.261339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:30:00.157065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:00.156986    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb"]
Jul 29 19:30:00.160557 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:00.160527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb"
Jul 29 19:30:00.162970 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:00.162948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:30:00.167391 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:00.167364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb"]
Jul 29 19:30:00.188960 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:00.188930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb"
Jul 29 19:30:00.328480 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:00.328433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb"]
Jul 29 19:30:00.331209 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:30:00.331182    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05457c24_2578_4d17_ae06_64190f7664e2.slice/crio-7ba6dd7fdbe3779992c36b643de2f3727903220eed36a1b7e46324de5cde1b86 WatchSource:0}: Error finding container 7ba6dd7fdbe3779992c36b643de2f3727903220eed36a1b7e46324de5cde1b86: Status 404 returned error can't find the container with id 7ba6dd7fdbe3779992c36b643de2f3727903220eed36a1b7e46324de5cde1b86
Jul 29 19:30:00.881334 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:00.881297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb" event={"ID":"05457c24-2578-4d17-ae06-64190f7664e2","Type":"ContainerStarted","Data":"7ba6dd7fdbe3779992c36b643de2f3727903220eed36a1b7e46324de5cde1b86"}
Jul 29 19:30:03.899749 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:03.899707    2576 generic.go:356] "Generic (PLEG): container finished" podID="05457c24-2578-4d17-ae06-64190f7664e2" containerID="18a99ce1c349e96dd23115512490e8c966e91c3ba57e23c4ee66a552b02d200e" exitCode=0
Jul 29 19:30:03.900179 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:03.899790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb" event={"ID":"05457c24-2578-4d17-ae06-64190f7664e2","Type":"ContainerDied","Data":"18a99ce1c349e96dd23115512490e8c966e91c3ba57e23c4ee66a552b02d200e"}
Jul 29 19:30:05.038090 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:05.038062    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb"
Jul 29 19:30:05.910648 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:05.910617    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb"
Jul 29 19:30:05.910828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:05.910658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755890-rlzvb" event={"ID":"05457c24-2578-4d17-ae06-64190f7664e2","Type":"ContainerDied","Data":"7ba6dd7fdbe3779992c36b643de2f3727903220eed36a1b7e46324de5cde1b86"}
Jul 29 19:30:05.910828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:30:05.910705    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ba6dd7fdbe3779992c36b643de2f3727903220eed36a1b7e46324de5cde1b86"
Jul 29 19:31:22.185558 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:31:22.185512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:50.300791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:31:50.300700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:50.400735 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:31:50.400693    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:43.013617 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:34:43.013578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:03.042801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:03.042751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:12.239100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.239053    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"]
Jul 29 19:37:12.239496 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.239403    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05457c24-2578-4d17-ae06-64190f7664e2" containerName="cleanup"
Jul 29 19:37:12.239496 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.239415    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05457c24-2578-4d17-ae06-64190f7664e2" containerName="cleanup"
Jul 29 19:37:12.239496 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.239477    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="05457c24-2578-4d17-ae06-64190f7664e2" containerName="cleanup"
Jul 29 19:37:12.241501 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.241484    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.243710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.243687    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-52b12a4b-kserve-self-signed-certs\""
Jul 29 19:37:12.256580 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.256537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"]
Jul 29 19:37:12.262975 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.262941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:12.393944 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.393908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tls-certs\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.393944 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.393946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-dshm\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.394165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.393976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-model-cache\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.394165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.394034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tmp-dir\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.394165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.394103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-home\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.394165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.394123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr6jn\" (UniqueName: \"kubernetes.io/projected/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-kube-api-access-zr6jn\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.494948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.494849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-home\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.494948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.494889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr6jn\" (UniqueName: \"kubernetes.io/projected/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-kube-api-access-zr6jn\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.494948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.494932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tls-certs\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.494948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.494950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-dshm\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.495293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.495061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-model-cache\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.495293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.495116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tmp-dir\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.495395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.495333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-home\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.495433 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.495408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-model-cache\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.495482 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.495462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tmp-dir\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.497271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.497251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-dshm\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.497524 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.497507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tls-certs\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.504350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.504325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr6jn\" (UniqueName: \"kubernetes.io/projected/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-kube-api-access-zr6jn\") pod \"e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") " pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.551271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.551217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:12.682694 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.682666    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"]
Jul 29 19:37:12.684712 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:37:12.684668    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d92926b_03ee_430c_ba57_bb8dbe78b0d0.slice/crio-416bf564f9c2330998c5a107c0d34fcf60166d8fccd4783056f075ccffde97f8 WatchSource:0}: Error finding container 416bf564f9c2330998c5a107c0d34fcf60166d8fccd4783056f075ccffde97f8: Status 404 returned error can't find the container with id 416bf564f9c2330998c5a107c0d34fcf60166d8fccd4783056f075ccffde97f8
Jul 29 19:37:12.998151 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.998117    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr" event={"ID":"3d92926b-03ee-430c-ba57-bb8dbe78b0d0","Type":"ContainerStarted","Data":"9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979"}
Jul 29 19:37:12.998151 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:12.998161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr" event={"ID":"3d92926b-03ee-430c-ba57-bb8dbe78b0d0","Type":"ContainerStarted","Data":"416bf564f9c2330998c5a107c0d34fcf60166d8fccd4783056f075ccffde97f8"}
Jul 29 19:37:13.018726 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:13.018669    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr" podStartSLOduration=1.018654076 podStartE2EDuration="1.018654076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:37:13.017789005 +0000 UTC m=+1326.913606273" watchObservedRunningTime="2026-07-29 19:37:13.018654076 +0000 UTC m=+1326.914471344"
Jul 29 19:37:22.551389 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:22.551346    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:22.551826 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:22.551417    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:22.564013 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:22.563985    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:23.060780 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:23.060745    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:39.689908 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:39.689815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:41.236028 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:41.235983    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"]
Jul 29 19:37:41.261156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:41.261116    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:56.255472 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.255407    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr" podUID="3d92926b-03ee-430c-ba57-bb8dbe78b0d0" containerName="main" containerID="cri-o://9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979" gracePeriod=45
Jul 29 19:37:56.501525 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.501499    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:56.575039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.574949    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tmp-dir\") pod \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") "
Jul 29 19:37:56.575039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.574988    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr6jn\" (UniqueName: \"kubernetes.io/projected/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-kube-api-access-zr6jn\") pod \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") "
Jul 29 19:37:56.575039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-model-cache\") pod \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") "
Jul 29 19:37:56.575320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575059    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tls-certs\") pod \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") "
Jul 29 19:37:56.575320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575116    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-home\") pod \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") "
Jul 29 19:37:56.575320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575141    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-dshm\") pod \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\" (UID: \"3d92926b-03ee-430c-ba57-bb8dbe78b0d0\") "
Jul 29 19:37:56.575320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3d92926b-03ee-430c-ba57-bb8dbe78b0d0" (UID: "3d92926b-03ee-430c-ba57-bb8dbe78b0d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:56.575529 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575338    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "3d92926b-03ee-430c-ba57-bb8dbe78b0d0" (UID: "3d92926b-03ee-430c-ba57-bb8dbe78b0d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:56.575529 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575405    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tmp-dir\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:37:56.575529 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.575404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-home" (OuterVolumeSpecName: "home") pod "3d92926b-03ee-430c-ba57-bb8dbe78b0d0" (UID: "3d92926b-03ee-430c-ba57-bb8dbe78b0d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:56.577345 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.577320    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3d92926b-03ee-430c-ba57-bb8dbe78b0d0" (UID: "3d92926b-03ee-430c-ba57-bb8dbe78b0d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:37:56.577428 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.577326    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-dshm" (OuterVolumeSpecName: "dshm") pod "3d92926b-03ee-430c-ba57-bb8dbe78b0d0" (UID: "3d92926b-03ee-430c-ba57-bb8dbe78b0d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:56.577428 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.577387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-kube-api-access-zr6jn" (OuterVolumeSpecName: "kube-api-access-zr6jn") pod "3d92926b-03ee-430c-ba57-bb8dbe78b0d0" (UID: "3d92926b-03ee-430c-ba57-bb8dbe78b0d0"). InnerVolumeSpecName "kube-api-access-zr6jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:37:56.676837 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.676795    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-model-cache\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:37:56.676837 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.676836    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-tls-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:37:56.676837 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.676844    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-home\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:37:56.676837 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.676853    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-dshm\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:37:56.677101 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:56.676861    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr6jn\" (UniqueName: \"kubernetes.io/projected/3d92926b-03ee-430c-ba57-bb8dbe78b0d0-kube-api-access-zr6jn\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:37:57.223791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.223752    2576 generic.go:356] "Generic (PLEG): container finished" podID="3d92926b-03ee-430c-ba57-bb8dbe78b0d0" containerID="9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979" exitCode=0
Jul 29 19:37:57.223791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.223790    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"
Jul 29 19:37:57.224134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.223839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr" event={"ID":"3d92926b-03ee-430c-ba57-bb8dbe78b0d0","Type":"ContainerDied","Data":"9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979"}
Jul 29 19:37:57.224134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.223885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr" event={"ID":"3d92926b-03ee-430c-ba57-bb8dbe78b0d0","Type":"ContainerDied","Data":"416bf564f9c2330998c5a107c0d34fcf60166d8fccd4783056f075ccffde97f8"}
Jul 29 19:37:57.224134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.223907    2576 scope.go:117] "RemoveContainer" containerID="9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979"
Jul 29 19:37:57.232777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.232756    2576 scope.go:117] "RemoveContainer" containerID="9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979"
Jul 29 19:37:57.233114 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:37:57.233089    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979\": container with ID starting with 9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979 not found: ID does not exist" containerID="9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979"
Jul 29 19:37:57.233169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.233126    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979"} err="failed to get container status \"9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979\": rpc error: code = NotFound desc = could not find container \"9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979\": container with ID starting with 9d5a40fd5603d65ffb1e2077b8c9c11575276747c925818094833b7fb7919979 not found: ID does not exist"
Jul 29 19:37:57.243329 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.243288    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"]
Jul 29 19:37:57.250731 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:57.250696    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-52b12a4b-kserve-b78f7d695-7ztnr"]
Jul 29 19:37:58.714425 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:37:58.714382    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d92926b-03ee-430c-ba57-bb8dbe78b0d0" path="/var/lib/kubelet/pods/3d92926b-03ee-430c-ba57-bb8dbe78b0d0/volumes"
Jul 29 19:40:27.322113 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:40:27.322065    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:50.412262 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:40:50.412171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:50.469788 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:40:50.469735    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:52.797519 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:40:52.797464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:14.389393 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:14.389335    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:17.343021 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:17.342978    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:17.534760 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:17.534726    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:17.915687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:17.915653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:23.971812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:23.971779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:24.072216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.072185    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:24.213162 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.213123    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:24.518957 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.518919    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"]
Jul 29 19:41:24.519284 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.519271    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d92926b-03ee-430c-ba57-bb8dbe78b0d0" containerName="main"
Jul 29 19:41:24.519330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.519285    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d92926b-03ee-430c-ba57-bb8dbe78b0d0" containerName="main"
Jul 29 19:41:24.519365 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.519341    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d92926b-03ee-430c-ba57-bb8dbe78b0d0" containerName="main"
Jul 29 19:41:24.522449 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.522429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.525378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.525355    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c5c29115-openshift-default-dockercfg-8965m\""
Jul 29 19:41:24.536673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.536643    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:24.546517 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.546483    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"]
Jul 29 19:41:24.637222 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.637193    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:24.684778 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.684740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7654b1b5-3e29-4869-9c29-460c15582142-istio-podinfo\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.684778 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.684783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cc6\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-kube-api-access-84cc6\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.684994 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.684824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-envoy\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.684994 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.684861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7654b1b5-3e29-4869-9c29-460c15582142-istiod-ca-cert\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.684994 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.684887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-istio-token\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.684994 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.684965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-socket\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.685122 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.684998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-credential-socket\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.685122 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.685027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-data\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.685122 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.685063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-certs\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7654b1b5-3e29-4869-9c29-460c15582142-istiod-ca-cert\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-istio-token\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-socket\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-credential-socket\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786737 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-data\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786737 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-certs\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786737 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7654b1b5-3e29-4869-9c29-460c15582142-istio-podinfo\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786737 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84cc6\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-kube-api-access-84cc6\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786737 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-envoy\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.786968 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-socket\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.787027 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.786959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-data\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.787027 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.787006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-certs\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.787123 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.787046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-credential-socket\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.787227 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.787204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7654b1b5-3e29-4869-9c29-460c15582142-istiod-ca-cert\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.788782 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.788763    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-envoy\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.789016 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.788998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7654b1b5-3e29-4869-9c29-460c15582142-istio-podinfo\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.799463 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.799437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-istio-token\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.800615 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.800596    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cc6\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-kube-api-access-84cc6\") pod \"e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") " pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.832531 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.832491    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:24.971515 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.971488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"]
Jul 29 19:41:24.973610 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:41:24.973583    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7654b1b5_3e29_4869_9c29_460c15582142.slice/crio-85b17bf01cd4b7fe9879a36348492a1b9daf69f8e5de88c6053cbb5ee460a6b6 WatchSource:0}: Error finding container 85b17bf01cd4b7fe9879a36348492a1b9daf69f8e5de88c6053cbb5ee460a6b6: Status 404 returned error can't find the container with id 85b17bf01cd4b7fe9879a36348492a1b9daf69f8e5de88c6053cbb5ee460a6b6
Jul 29 19:41:24.975830 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:24.975812    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:41:25.255839 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:25.255796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" event={"ID":"7654b1b5-3e29-4869-9c29-460c15582142","Type":"ContainerStarted","Data":"85b17bf01cd4b7fe9879a36348492a1b9daf69f8e5de88c6053cbb5ee460a6b6"}
Jul 29 19:41:27.563907 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:27.563876    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:41:27.564169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:27.563942    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:41:27.564169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:27.563972    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:41:28.275825 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:28.275789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" event={"ID":"7654b1b5-3e29-4869-9c29-460c15582142","Type":"ContainerStarted","Data":"a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506"}
Jul 29 19:41:28.297866 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:28.297808    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" podStartSLOduration=1.710174978 podStartE2EDuration="4.297788679s" totalImagesPullingTime="2.587613701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:41:28.297329838 +0000 UTC m=+1582.193147103" watchObservedRunningTime="2026-07-29 19:41:28.297788679 +0000 UTC m=+1582.193605949"
Jul 29 19:41:28.832727 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:28.832693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:28.837709 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:28.837681    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:29.281002 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.280970    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:29.281974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.281956    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:29.698945 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.698861    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:29.751569 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.751514    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"]
Jul 29 19:41:29.754715 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.754691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.757293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.757275    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c5c29115-serving-cert\""
Jul 29 19:41:29.769095 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.769070    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"]
Jul 29 19:41:29.799204 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.799170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:29.828590 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.828522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfafada1-c44a-45fa-9aac-2ad19040e621-openshift-service-ca\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.828766 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.828604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfafada1-c44a-45fa-9aac-2ad19040e621-maas-api-tls\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.828766 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.828631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2rw\" (UniqueName: \"kubernetes.io/projected/bfafada1-c44a-45fa-9aac-2ad19040e621-kube-api-access-xz2rw\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.898403 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.898357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:29.930145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.930105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfafada1-c44a-45fa-9aac-2ad19040e621-openshift-service-ca\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.930145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.930150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfafada1-c44a-45fa-9aac-2ad19040e621-maas-api-tls\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.930358 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.930174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2rw\" (UniqueName: \"kubernetes.io/projected/bfafada1-c44a-45fa-9aac-2ad19040e621-kube-api-access-xz2rw\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.930816 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.930789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfafada1-c44a-45fa-9aac-2ad19040e621-openshift-service-ca\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.932965 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.932942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfafada1-c44a-45fa-9aac-2ad19040e621-maas-api-tls\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.939530 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.939501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2rw\" (UniqueName: \"kubernetes.io/projected/bfafada1-c44a-45fa-9aac-2ad19040e621-kube-api-access-xz2rw\") pod \"maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:29.989569 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:29.989460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:30.067657 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.067607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:30.208575 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.208523    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"]
Jul 29 19:41:30.213791 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:41:30.213753    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfafada1_c44a_45fa_9aac_2ad19040e621.slice/crio-dea76ecac72bde2b1d4f1e9c00ced983a031ee76f7aaf9149133fa83dfa15b2e WatchSource:0}: Error finding container dea76ecac72bde2b1d4f1e9c00ced983a031ee76f7aaf9149133fa83dfa15b2e: Status 404 returned error can't find the container with id dea76ecac72bde2b1d4f1e9c00ced983a031ee76f7aaf9149133fa83dfa15b2e
Jul 29 19:41:30.287752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.287711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd" event={"ID":"bfafada1-c44a-45fa-9aac-2ad19040e621","Type":"ContainerStarted","Data":"dea76ecac72bde2b1d4f1e9c00ced983a031ee76f7aaf9149133fa83dfa15b2e"}
Jul 29 19:41:30.355186 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.355150    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:30.453858 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.453817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:30.464389 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.464362    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"]
Jul 29 19:41:30.468864 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.468848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.471640 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.471617    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c5c29115\""
Jul 29 19:41:30.471788 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.471767    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c5c29115-dockercfg-296t2\""
Jul 29 19:41:30.479752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.479718    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"]
Jul 29 19:41:30.492335 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.492303    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"]
Jul 29 19:41:30.495942 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.495922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.506155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.505822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"]
Jul 29 19:41:30.534873 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.534841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrgnt\" (UniqueName: \"kubernetes.io/projected/d889ee7b-29e0-45f6-85db-3afd72445579-kube-api-access-xrgnt\") pod \"payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.535022 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.534888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6547\" (UniqueName: \"kubernetes.io/projected/620d95ae-6805-4e89-b41d-df4a0b7c6257-kube-api-access-v6547\") pod \"payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") " pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.535022 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.534950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/620d95ae-6805-4e89-b41d-df4a0b7c6257-plugins-config-volume\") pod \"payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") " pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.535022 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.534978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d889ee7b-29e0-45f6-85db-3afd72445579-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.636265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.636178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6547\" (UniqueName: \"kubernetes.io/projected/620d95ae-6805-4e89-b41d-df4a0b7c6257-kube-api-access-v6547\") pod \"payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") " pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.636265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.636256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/620d95ae-6805-4e89-b41d-df4a0b7c6257-plugins-config-volume\") pod \"payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") " pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.636466 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.636303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d889ee7b-29e0-45f6-85db-3afd72445579-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.636466 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.636362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrgnt\" (UniqueName: \"kubernetes.io/projected/d889ee7b-29e0-45f6-85db-3afd72445579-kube-api-access-xrgnt\") pod \"payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.637265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.637242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d889ee7b-29e0-45f6-85db-3afd72445579-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.637321 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.637242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/620d95ae-6805-4e89-b41d-df4a0b7c6257-plugins-config-volume\") pod \"payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") " pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.645285 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.645261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrgnt\" (UniqueName: \"kubernetes.io/projected/d889ee7b-29e0-45f6-85db-3afd72445579-kube-api-access-xrgnt\") pod \"payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.645400 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.645297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6547\" (UniqueName: \"kubernetes.io/projected/620d95ae-6805-4e89-b41d-df4a0b7c6257-kube-api-access-v6547\") pod \"payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") " pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.779990 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.779969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:30.808336 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.808310    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:30.932941 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.932862    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"]
Jul 29 19:41:30.936239 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:41:30.936182    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd889ee7b_29e0_45f6_85db_3afd72445579.slice/crio-b84a37cdf1cf5646bde6f129a51b4b12975e3848f9d955509856e4e433eb316d WatchSource:0}: Error finding container b84a37cdf1cf5646bde6f129a51b4b12975e3848f9d955509856e4e433eb316d: Status 404 returned error can't find the container with id b84a37cdf1cf5646bde6f129a51b4b12975e3848f9d955509856e4e433eb316d
Jul 29 19:41:30.967185 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:30.967157    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"]
Jul 29 19:41:30.978734 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:41:30.978699    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620d95ae_6805_4e89_b41d_df4a0b7c6257.slice/crio-fc5428adfd47a29fc9e500dfff0d8b7e3e80dbb119452f4f9f893ecf72aca380 WatchSource:0}: Error finding container fc5428adfd47a29fc9e500dfff0d8b7e3e80dbb119452f4f9f893ecf72aca380: Status 404 returned error can't find the container with id fc5428adfd47a29fc9e500dfff0d8b7e3e80dbb119452f4f9f893ecf72aca380
Jul 29 19:41:31.293777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.293741    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd" event={"ID":"bfafada1-c44a-45fa-9aac-2ad19040e621","Type":"ContainerStarted","Data":"c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0"}
Jul 29 19:41:31.293948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.293833    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:31.295145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.295126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk" event={"ID":"d889ee7b-29e0-45f6-85db-3afd72445579","Type":"ContainerStarted","Data":"532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce"}
Jul 29 19:41:31.295264 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.295162    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:31.295264 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.295183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk" event={"ID":"d889ee7b-29e0-45f6-85db-3afd72445579","Type":"ContainerStarted","Data":"b84a37cdf1cf5646bde6f129a51b4b12975e3848f9d955509856e4e433eb316d"}
Jul 29 19:41:31.296503 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.296483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x" event={"ID":"620d95ae-6805-4e89-b41d-df4a0b7c6257","Type":"ContainerStarted","Data":"7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924"}
Jul 29 19:41:31.296618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.296518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x" event={"ID":"620d95ae-6805-4e89-b41d-df4a0b7c6257","Type":"ContainerStarted","Data":"fc5428adfd47a29fc9e500dfff0d8b7e3e80dbb119452f4f9f893ecf72aca380"}
Jul 29 19:41:31.296661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.296653    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:31.313975 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.313922    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd" podStartSLOduration=1.759010597 podStartE2EDuration="2.31390478s" totalImagesPullingTime="554.894183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:41:31.311243129 +0000 UTC m=+1585.207060425" watchObservedRunningTime="2026-07-29 19:41:31.31390478 +0000 UTC m=+1585.209722049"
Jul 29 19:41:31.329832 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.329776    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x" podStartSLOduration=1.329760588 podStartE2EDuration="1.329760588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:41:31.32731854 +0000 UTC m=+1585.223135809" watchObservedRunningTime="2026-07-29 19:41:31.329760588 +0000 UTC m=+1585.225577856"
Jul 29 19:41:31.346319 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:31.346261    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk" podStartSLOduration=1.346240345 podStartE2EDuration="1.346240345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:41:31.345093431 +0000 UTC m=+1585.240910700" watchObservedRunningTime="2026-07-29 19:41:31.346240345 +0000 UTC m=+1585.242057615"
Jul 29 19:41:32.507072 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:32.507034    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:32.567114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:32.567083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:37.309605 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:37.309576    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:41:41.356365 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:41.356329    2576 generic.go:356] "Generic (PLEG): container finished" podID="7654b1b5-3e29-4869-9c29-460c15582142" containerID="a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506" exitCode=0
Jul 29 19:41:41.356807 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:41.356398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" event={"ID":"7654b1b5-3e29-4869-9c29-460c15582142","Type":"ContainerDied","Data":"a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506"}
Jul 29 19:41:41.356858 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:41.356807    2576 scope.go:117] "RemoveContainer" containerID="a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506"
Jul 29 19:41:41.357860 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:41.357836    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:41:41.357933 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:41.357903    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:41:41.357975 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:41.357935    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:41:42.306342 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:42.306313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:41:42.306570 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:42.306391    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:41:42.369645 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:42.369598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" event={"ID":"7654b1b5-3e29-4869-9c29-460c15582142","Type":"ContainerStarted","Data":"0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527"}
Jul 29 19:41:42.832843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:42.832802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:42.834032 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:42.834001    2576 patch_prober.go:28] interesting pod/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 19:41:42.834309 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:42.834268    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 19:41:43.833405 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:43.833359    2576 patch_prober.go:28] interesting pod/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 19:41:43.833917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:43.833424    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 19:41:44.281378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:44.281338    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:44.833580 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:44.833509    2576 patch_prober.go:28] interesting pod/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 19:41:44.834094 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:44.833614    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 19:41:45.833741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:45.833701    2576 patch_prober.go:28] interesting pod/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 29 19:41:45.834335 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:45.834300    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 29 19:41:46.837246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:46.837215    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:41:46.838459 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:41:46.838440    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:42:10.679442 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:10.679337    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"]
Jul 29 19:42:10.680032 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:10.679698    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd" podUID="bfafada1-c44a-45fa-9aac-2ad19040e621" containerName="maas-api" containerID="cri-o://c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0" gracePeriod=30
Jul 29 19:42:10.706085 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:10.706041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:10.752269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:10.751531    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"]
Jul 29 19:42:10.752441 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:10.752166    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x" podUID="620d95ae-6805-4e89-b41d-df4a0b7c6257" containerName="payload-processing" containerID="cri-o://7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924" gracePeriod=30
Jul 29 19:42:10.759485 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:10.759459    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"]
Jul 29 19:42:10.759709 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:10.759687    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk" podUID="d889ee7b-29e0-45f6-85db-3afd72445579" containerName="payload-pre-processing" containerID="cri-o://532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce" gracePeriod=30
Jul 29 19:42:11.007358 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.007313    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:42:11.009205 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.009176    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz2rw\" (UniqueName: \"kubernetes.io/projected/bfafada1-c44a-45fa-9aac-2ad19040e621-kube-api-access-xz2rw\") pod \"bfafada1-c44a-45fa-9aac-2ad19040e621\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") "
Jul 29 19:42:11.009344 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.009231    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfafada1-c44a-45fa-9aac-2ad19040e621-maas-api-tls\") pod \"bfafada1-c44a-45fa-9aac-2ad19040e621\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") "
Jul 29 19:42:11.009344 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.009298    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfafada1-c44a-45fa-9aac-2ad19040e621-openshift-service-ca\") pod \"bfafada1-c44a-45fa-9aac-2ad19040e621\" (UID: \"bfafada1-c44a-45fa-9aac-2ad19040e621\") "
Jul 29 19:42:11.009865 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.009829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfafada1-c44a-45fa-9aac-2ad19040e621-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bfafada1-c44a-45fa-9aac-2ad19040e621" (UID: "bfafada1-c44a-45fa-9aac-2ad19040e621"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:11.012679 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.012597    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfafada1-c44a-45fa-9aac-2ad19040e621-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bfafada1-c44a-45fa-9aac-2ad19040e621" (UID: "bfafada1-c44a-45fa-9aac-2ad19040e621"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:42:11.012679 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.012643    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfafada1-c44a-45fa-9aac-2ad19040e621-kube-api-access-xz2rw" (OuterVolumeSpecName: "kube-api-access-xz2rw") pod "bfafada1-c44a-45fa-9aac-2ad19040e621" (UID: "bfafada1-c44a-45fa-9aac-2ad19040e621"). InnerVolumeSpecName "kube-api-access-xz2rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:11.042587 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.042539    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:42:11.046964 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.046908    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"]
Jul 29 19:42:11.047226 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.047198    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy" containerID="cri-o://0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527" gracePeriod=30
Jul 29 19:42:11.056239 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.056215    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:42:11.110074 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110042    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrgnt\" (UniqueName: \"kubernetes.io/projected/d889ee7b-29e0-45f6-85db-3afd72445579-kube-api-access-xrgnt\") pod \"d889ee7b-29e0-45f6-85db-3afd72445579\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") "
Jul 29 19:42:11.110275 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110092    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6547\" (UniqueName: \"kubernetes.io/projected/620d95ae-6805-4e89-b41d-df4a0b7c6257-kube-api-access-v6547\") pod \"620d95ae-6805-4e89-b41d-df4a0b7c6257\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") "
Jul 29 19:42:11.110275 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110127    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d889ee7b-29e0-45f6-85db-3afd72445579-plugins-config-volume\") pod \"d889ee7b-29e0-45f6-85db-3afd72445579\" (UID: \"d889ee7b-29e0-45f6-85db-3afd72445579\") "
Jul 29 19:42:11.110275 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110195    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/620d95ae-6805-4e89-b41d-df4a0b7c6257-plugins-config-volume\") pod \"620d95ae-6805-4e89-b41d-df4a0b7c6257\" (UID: \"620d95ae-6805-4e89-b41d-df4a0b7c6257\") "
Jul 29 19:42:11.110446 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110377    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz2rw\" (UniqueName: \"kubernetes.io/projected/bfafada1-c44a-45fa-9aac-2ad19040e621-kube-api-access-xz2rw\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:11.110446 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110395    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfafada1-c44a-45fa-9aac-2ad19040e621-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:11.110446 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110408    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfafada1-c44a-45fa-9aac-2ad19040e621-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:11.110644 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110618    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d889ee7b-29e0-45f6-85db-3afd72445579-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d889ee7b-29e0-45f6-85db-3afd72445579" (UID: "d889ee7b-29e0-45f6-85db-3afd72445579"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:11.110739 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.110702    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/620d95ae-6805-4e89-b41d-df4a0b7c6257-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "620d95ae-6805-4e89-b41d-df4a0b7c6257" (UID: "620d95ae-6805-4e89-b41d-df4a0b7c6257"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:11.112310 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.112288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d889ee7b-29e0-45f6-85db-3afd72445579-kube-api-access-xrgnt" (OuterVolumeSpecName: "kube-api-access-xrgnt") pod "d889ee7b-29e0-45f6-85db-3afd72445579" (UID: "d889ee7b-29e0-45f6-85db-3afd72445579"). InnerVolumeSpecName "kube-api-access-xrgnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:11.112427 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.112361    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620d95ae-6805-4e89-b41d-df4a0b7c6257-kube-api-access-v6547" (OuterVolumeSpecName: "kube-api-access-v6547") pod "620d95ae-6805-4e89-b41d-df4a0b7c6257" (UID: "620d95ae-6805-4e89-b41d-df4a0b7c6257"). InnerVolumeSpecName "kube-api-access-v6547". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:11.210974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.210880    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/620d95ae-6805-4e89-b41d-df4a0b7c6257-plugins-config-volume\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:11.210974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.210913    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrgnt\" (UniqueName: \"kubernetes.io/projected/d889ee7b-29e0-45f6-85db-3afd72445579-kube-api-access-xrgnt\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:11.210974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.210924    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6547\" (UniqueName: \"kubernetes.io/projected/620d95ae-6805-4e89-b41d-df4a0b7c6257-kube-api-access-v6547\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:11.210974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.210934    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d889ee7b-29e0-45f6-85db-3afd72445579-plugins-config-volume\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:11.519777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.519744    2576 generic.go:356] "Generic (PLEG): container finished" podID="620d95ae-6805-4e89-b41d-df4a0b7c6257" containerID="7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924" exitCode=0
Jul 29 19:42:11.519982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.519789    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"
Jul 29 19:42:11.519982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.519829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x" event={"ID":"620d95ae-6805-4e89-b41d-df4a0b7c6257","Type":"ContainerDied","Data":"7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924"}
Jul 29 19:42:11.519982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.519884    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x" event={"ID":"620d95ae-6805-4e89-b41d-df4a0b7c6257","Type":"ContainerDied","Data":"fc5428adfd47a29fc9e500dfff0d8b7e3e80dbb119452f4f9f893ecf72aca380"}
Jul 29 19:42:11.519982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.519911    2576 scope.go:117] "RemoveContainer" containerID="7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924"
Jul 29 19:42:11.521296 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.521271    2576 generic.go:356] "Generic (PLEG): container finished" podID="bfafada1-c44a-45fa-9aac-2ad19040e621" containerID="c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0" exitCode=0
Jul 29 19:42:11.521407 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.521317    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"
Jul 29 19:42:11.521407 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.521349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd" event={"ID":"bfafada1-c44a-45fa-9aac-2ad19040e621","Type":"ContainerDied","Data":"c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0"}
Jul 29 19:42:11.521407 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.521400    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd" event={"ID":"bfafada1-c44a-45fa-9aac-2ad19040e621","Type":"ContainerDied","Data":"dea76ecac72bde2b1d4f1e9c00ced983a031ee76f7aaf9149133fa83dfa15b2e"}
Jul 29 19:42:11.523274 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.523194    2576 generic.go:356] "Generic (PLEG): container finished" podID="d889ee7b-29e0-45f6-85db-3afd72445579" containerID="532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce" exitCode=0
Jul 29 19:42:11.523274 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.523232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk" event={"ID":"d889ee7b-29e0-45f6-85db-3afd72445579","Type":"ContainerDied","Data":"532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce"}
Jul 29 19:42:11.523439 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.523302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk" event={"ID":"d889ee7b-29e0-45f6-85db-3afd72445579","Type":"ContainerDied","Data":"b84a37cdf1cf5646bde6f129a51b4b12975e3848f9d955509856e4e433eb316d"}
Jul 29 19:42:11.523439 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.523254    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"
Jul 29 19:42:11.530752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.530731    2576 scope.go:117] "RemoveContainer" containerID="7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924"
Jul 29 19:42:11.531310 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:11.531103    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924\": container with ID starting with 7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924 not found: ID does not exist" containerID="7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924"
Jul 29 19:42:11.531310 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.531154    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924"} err="failed to get container status \"7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924\": rpc error: code = NotFound desc = could not find container \"7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924\": container with ID starting with 7ca5d0bcc4c9af0a5a4fefff63263d0bca87d56bdc0e1adbc50cb92833b57924 not found: ID does not exist"
Jul 29 19:42:11.531310 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.531184    2576 scope.go:117] "RemoveContainer" containerID="c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0"
Jul 29 19:42:11.540680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.540654    2576 scope.go:117] "RemoveContainer" containerID="c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0"
Jul 29 19:42:11.540963 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:11.540940    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0\": container with ID starting with c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0 not found: ID does not exist" containerID="c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0"
Jul 29 19:42:11.541046 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.540976    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0"} err="failed to get container status \"c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0\": rpc error: code = NotFound desc = could not find container \"c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0\": container with ID starting with c0ce67a40a1d7c95868012af0ad6be5d5ec739048a9de28b6726e832a15f8fb0 not found: ID does not exist"
Jul 29 19:42:11.541046 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.540999    2576 scope.go:117] "RemoveContainer" containerID="532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce"
Jul 29 19:42:11.549329 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.549308    2576 scope.go:117] "RemoveContainer" containerID="532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce"
Jul 29 19:42:11.549669 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:11.549645    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce\": container with ID starting with 532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce not found: ID does not exist" containerID="532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce"
Jul 29 19:42:11.549741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.549679    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce"} err="failed to get container status \"532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce\": rpc error: code = NotFound desc = could not find container \"532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce\": container with ID starting with 532fe4f267c39075ac96a9d33db1f37d31946f3520bc4de509a12d4ef65a51ce not found: ID does not exist"
Jul 29 19:42:11.560137 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.560107    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"]
Jul 29 19:42:11.564718 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.564689    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5c29115-6b4b6c56f6-7hlhk"]
Jul 29 19:42:11.590362 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.590323    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"]
Jul 29 19:42:11.595959 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.595934    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c29115-79c5fb5bd6-mt6cd"]
Jul 29 19:42:11.619920 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.619892    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"]
Jul 29 19:42:11.623603 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:11.623570    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5c29115-86f5fc4bb6-qpn2x"]
Jul 29 19:42:12.081257 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081224    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"]
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081574    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d889ee7b-29e0-45f6-85db-3afd72445579" containerName="payload-pre-processing"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081586    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d889ee7b-29e0-45f6-85db-3afd72445579" containerName="payload-pre-processing"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081606    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfafada1-c44a-45fa-9aac-2ad19040e621" containerName="maas-api"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081611    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfafada1-c44a-45fa-9aac-2ad19040e621" containerName="maas-api"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081621    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620d95ae-6805-4e89-b41d-df4a0b7c6257" containerName="payload-processing"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081627    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="620d95ae-6805-4e89-b41d-df4a0b7c6257" containerName="payload-processing"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081682    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfafada1-c44a-45fa-9aac-2ad19040e621" containerName="maas-api"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081694    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d889ee7b-29e0-45f6-85db-3afd72445579" containerName="payload-pre-processing"
Jul 29 19:42:12.081697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.081700    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="620d95ae-6805-4e89-b41d-df4a0b7c6257" containerName="payload-processing"
Jul 29 19:42:12.086151 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.086125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.088812 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.088783    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-57a0d2c8-gw-openshift-default-dockercfg-94r9m\""
Jul 29 19:42:12.098092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.098063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"]
Jul 29 19:42:12.120743 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.120712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfkg\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-kube-api-access-crfkg\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.120912 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.120765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-socket\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.120912 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.120801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-data\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.120912 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.120866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-envoy\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.121042 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.120934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-podinfo\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.121042 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.120965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-credential-socket\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.121042 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.121008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9c5e0e-3f86-4864-af30-165e664d6eec-istiod-ca-cert\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.121134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.121063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-certs\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.121134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.121086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-token\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.124212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.124178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:12.222430 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-socket\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222430 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-data\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222674 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-envoy\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222674 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-podinfo\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222674 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-credential-socket\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222674 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9c5e0e-3f86-4864-af30-165e664d6eec-istiod-ca-cert\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-certs\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-token\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crfkg\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-kube-api-access-crfkg\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.222887 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-data\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.223100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-socket\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.223100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.222988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-credential-socket\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.223347 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.223329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-certs\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.223415 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.223366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9c5e0e-3f86-4864-af30-165e664d6eec-istiod-ca-cert\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.225038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.225018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-podinfo\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.225154 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.225102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-envoy\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.253953 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.253921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfkg\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-kube-api-access-crfkg\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.291867 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.291840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-token\") pod \"e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") " pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.314583 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.314552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:12.396928 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.396822    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:12.550366 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.550341    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"]
Jul 29 19:42:12.552151 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:42:12.552131    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9c5e0e_3f86_4864_af30_165e664d6eec.slice/crio-def169fa7e1ebf2a2ec644b25b4625c0e54063869b3eb2be3f0e0487862396d2 WatchSource:0}: Error finding container def169fa7e1ebf2a2ec644b25b4625c0e54063869b3eb2be3f0e0487862396d2: Status 404 returned error can't find the container with id def169fa7e1ebf2a2ec644b25b4625c0e54063869b3eb2be3f0e0487862396d2
Jul 29 19:42:12.554103 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.554073    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:12.554161 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.554140    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:12.554198 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.554169    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:12.720625 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.720522    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="620d95ae-6805-4e89-b41d-df4a0b7c6257" path="/var/lib/kubelet/pods/620d95ae-6805-4e89-b41d-df4a0b7c6257/volumes"
Jul 29 19:42:12.721016 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.720995    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfafada1-c44a-45fa-9aac-2ad19040e621" path="/var/lib/kubelet/pods/bfafada1-c44a-45fa-9aac-2ad19040e621/volumes"
Jul 29 19:42:12.721455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:12.721433    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d889ee7b-29e0-45f6-85db-3afd72445579" path="/var/lib/kubelet/pods/d889ee7b-29e0-45f6-85db-3afd72445579/volumes"
Jul 29 19:42:13.541366 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:13.541326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" event={"ID":"ea9c5e0e-3f86-4864-af30-165e664d6eec","Type":"ContainerStarted","Data":"123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac"}
Jul 29 19:42:13.541763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:13.541383    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" event={"ID":"ea9c5e0e-3f86-4864-af30-165e664d6eec","Type":"ContainerStarted","Data":"def169fa7e1ebf2a2ec644b25b4625c0e54063869b3eb2be3f0e0487862396d2"}
Jul 29 19:42:13.570101 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:13.570042    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podStartSLOduration=1.570025797 podStartE2EDuration="1.570025797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:13.569291433 +0000 UTC m=+1627.465108692" watchObservedRunningTime="2026-07-29 19:42:13.570025797 +0000 UTC m=+1627.465843065"
Jul 29 19:42:14.397608 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:14.397570    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:14.402300 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:14.402274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:14.546245 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:14.546214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:14.547270 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:14.547251    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:15.060455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.060419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:15.138278 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.138247    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"]
Jul 29 19:42:15.142803 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.142781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.145289 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.145262    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-57a0d2c8-serving-cert\""
Jul 29 19:42:15.152108 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.152078    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"]
Jul 29 19:42:15.170086 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.170056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:15.250462 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.250424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.250660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.250469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26e5a8a7-6483-4405-b459-779ffa83fdba-openshift-service-ca\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.250660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.250628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv85n\" (UniqueName: \"kubernetes.io/projected/26e5a8a7-6483-4405-b459-779ffa83fdba-kube-api-access-nv85n\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.351830 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.351728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.351830 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.351775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26e5a8a7-6483-4405-b459-779ffa83fdba-openshift-service-ca\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.352034 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.351843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv85n\" (UniqueName: \"kubernetes.io/projected/26e5a8a7-6483-4405-b459-779ffa83fdba-kube-api-access-nv85n\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.352034 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:15.351884    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-serving-cert: secret "maas-api-e2e-migrate-57a0d2c8-serving-cert" not found
Jul 29 19:42:15.352034 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:15.351953    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls podName:26e5a8a7-6483-4405-b459-779ffa83fdba nodeName:}" failed. No retries permitted until 2026-07-29 19:42:15.85193528 +0000 UTC m=+1629.747752527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls") pod "maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd" (UID: "26e5a8a7-6483-4405-b459-779ffa83fdba") : secret "maas-api-e2e-migrate-57a0d2c8-serving-cert" not found
Jul 29 19:42:15.352516 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.352497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26e5a8a7-6483-4405-b459-779ffa83fdba-openshift-service-ca\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.360984 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.360965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv85n\" (UniqueName: \"kubernetes.io/projected/26e5a8a7-6483-4405-b459-779ffa83fdba-kube-api-access-nv85n\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.469664 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.469625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:15.698575 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.698474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:15.798525 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.798492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:15.840165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.840126    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"]
Jul 29 19:42:15.843742 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.843717    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:15.846265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.846239    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-57a0d2c8\""
Jul 29 19:42:15.846395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.846239    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-57a0d2c8-dockercfg-wnx6k\""
Jul 29 19:42:15.853615 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.853587    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"]
Jul 29 19:42:15.856093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.856070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.858508 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.858479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls\") pod \"maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:15.882875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.882840    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"]
Jul 29 19:42:15.886115 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.886098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:15.893831 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.893762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"]
Jul 29 19:42:15.957407 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.957315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l52xb\" (UniqueName: \"kubernetes.io/projected/c4c30142-6232-4edd-92e2-13876aea14dc-kube-api-access-l52xb\") pod \"payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") " pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:15.957407 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.957361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmwhn\" (UniqueName: \"kubernetes.io/projected/a5dd1f28-100d-4d35-ac97-617fc349d5f4-kube-api-access-lmwhn\") pod \"payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:15.957631 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.957413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c30142-6232-4edd-92e2-13876aea14dc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") " pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:15.957631 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:15.957449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd1f28-100d-4d35-ac97-617fc349d5f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:16.055103 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.055064    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:16.057923 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.057899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd1f28-100d-4d35-ac97-617fc349d5f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:16.058063 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.057982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l52xb\" (UniqueName: \"kubernetes.io/projected/c4c30142-6232-4edd-92e2-13876aea14dc-kube-api-access-l52xb\") pod \"payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") " pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:16.058063 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.058020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmwhn\" (UniqueName: \"kubernetes.io/projected/a5dd1f28-100d-4d35-ac97-617fc349d5f4-kube-api-access-lmwhn\") pod \"payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:16.058177 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.058069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c30142-6232-4edd-92e2-13876aea14dc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") " pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:16.059006 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.058970    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c30142-6232-4edd-92e2-13876aea14dc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") " pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:16.059360 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.058973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd1f28-100d-4d35-ac97-617fc349d5f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:16.068914 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.068882    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmwhn\" (UniqueName: \"kubernetes.io/projected/a5dd1f28-100d-4d35-ac97-617fc349d5f4-kube-api-access-lmwhn\") pod \"payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:16.069028 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.068882    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l52xb\" (UniqueName: \"kubernetes.io/projected/c4c30142-6232-4edd-92e2-13876aea14dc-kube-api-access-l52xb\") pod \"payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") " pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:16.156299 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.156250    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:16.197762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.197721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:16.202419 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.202340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"]
Jul 29 19:42:16.206579 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:42:16.206480    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e5a8a7_6483_4405_b459_779ffa83fdba.slice/crio-02146663ba1fbed082bae8df8c601bd487fd727f65379b9db3d780fbb855db16 WatchSource:0}: Error finding container 02146663ba1fbed082bae8df8c601bd487fd727f65379b9db3d780fbb855db16: Status 404 returned error can't find the container with id 02146663ba1fbed082bae8df8c601bd487fd727f65379b9db3d780fbb855db16
Jul 29 19:42:16.342884 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.342738    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"]
Jul 29 19:42:16.348948 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:42:16.348894    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c30142_6232_4edd_92e2_13876aea14dc.slice/crio-1671528b32e6e0a663dafb406ec9a18fb5ed275ab5f328d65959f803fd9a9d8a WatchSource:0}: Error finding container 1671528b32e6e0a663dafb406ec9a18fb5ed275ab5f328d65959f803fd9a9d8a: Status 404 returned error can't find the container with id 1671528b32e6e0a663dafb406ec9a18fb5ed275ab5f328d65959f803fd9a9d8a
Jul 29 19:42:16.357747 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.357659    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:42:16.395635 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.395588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"]
Jul 29 19:42:16.401777 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:42:16.401749    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5dd1f28_100d_4d35_ac97_617fc349d5f4.slice/crio-eddc184f1df6404a88b048df2ef11c19bea4e35ec43c683583b45a74dff7a916 WatchSource:0}: Error finding container eddc184f1df6404a88b048df2ef11c19bea4e35ec43c683583b45a74dff7a916: Status 404 returned error can't find the container with id eddc184f1df6404a88b048df2ef11c19bea4e35ec43c683583b45a74dff7a916
Jul 29 19:42:16.461278 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461196    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7654b1b5-3e29-4869-9c29-460c15582142-istiod-ca-cert\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.461452 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461355    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-credential-socket\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.461574 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7654b1b5-3e29-4869-9c29-460c15582142-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:16.461703 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:16.461790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461736    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-istio-token\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.461894 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461873    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-socket\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.462025 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461902    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-envoy\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.462025 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.461927    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-certs\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.462155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462117    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:16.462211 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:16.462211 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-data\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.462311 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462258    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7654b1b5-3e29-4869-9c29-460c15582142-istio-podinfo\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.462311 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462300    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84cc6\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-kube-api-access-84cc6\") pod \"7654b1b5-3e29-4869-9c29-460c15582142\" (UID: \"7654b1b5-3e29-4869-9c29-460c15582142\") "
Jul 29 19:42:16.462687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462666    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.462819 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462805    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.462935 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462916    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.462935 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462936    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7654b1b5-3e29-4869-9c29-460c15582142-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.463100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.462852    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-data" (OuterVolumeSpecName: "istio-data") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:16.464536 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.464489    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7654b1b5-3e29-4869-9c29-460c15582142-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:42:16.464691 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.464664    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-istio-token" (OuterVolumeSpecName: "istio-token") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:16.464951 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.464932    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:16.465617 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.465519    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-kube-api-access-84cc6" (OuterVolumeSpecName: "kube-api-access-84cc6") pod "7654b1b5-3e29-4869-9c29-460c15582142" (UID: "7654b1b5-3e29-4869-9c29-460c15582142"). InnerVolumeSpecName "kube-api-access-84cc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:16.558063 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.558026    2576 generic.go:356] "Generic (PLEG): container finished" podID="7654b1b5-3e29-4869-9c29-460c15582142" containerID="0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527" exitCode=0
Jul 29 19:42:16.558271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.558109    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"
Jul 29 19:42:16.558271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.558122    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" event={"ID":"7654b1b5-3e29-4869-9c29-460c15582142","Type":"ContainerDied","Data":"0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527"}
Jul 29 19:42:16.558271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.558176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh" event={"ID":"7654b1b5-3e29-4869-9c29-460c15582142","Type":"ContainerDied","Data":"85b17bf01cd4b7fe9879a36348492a1b9daf69f8e5de88c6053cbb5ee460a6b6"}
Jul 29 19:42:16.558271 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.558205    2576 scope.go:117] "RemoveContainer" containerID="0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527"
Jul 29 19:42:16.560262 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.560225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7" event={"ID":"a5dd1f28-100d-4d35-ac97-617fc349d5f4","Type":"ContainerStarted","Data":"078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5"}
Jul 29 19:42:16.560404 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.560294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7" event={"ID":"a5dd1f28-100d-4d35-ac97-617fc349d5f4","Type":"ContainerStarted","Data":"eddc184f1df6404a88b048df2ef11c19bea4e35ec43c683583b45a74dff7a916"}
Jul 29 19:42:16.560619 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.560593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:16.562601 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.562539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b" event={"ID":"c4c30142-6232-4edd-92e2-13876aea14dc","Type":"ContainerStarted","Data":"4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1"}
Jul 29 19:42:16.562752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.562625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b" event={"ID":"c4c30142-6232-4edd-92e2-13876aea14dc","Type":"ContainerStarted","Data":"1671528b32e6e0a663dafb406ec9a18fb5ed275ab5f328d65959f803fd9a9d8a"}
Jul 29 19:42:16.562752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.562657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:16.563431 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.563405    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.563528 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.563452    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.563528 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.563466    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7654b1b5-3e29-4869-9c29-460c15582142-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.563528 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.563481    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7654b1b5-3e29-4869-9c29-460c15582142-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.563528 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.563496    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84cc6\" (UniqueName: \"kubernetes.io/projected/7654b1b5-3e29-4869-9c29-460c15582142-kube-api-access-84cc6\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:16.563917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.563893    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd" event={"ID":"26e5a8a7-6483-4405-b459-779ffa83fdba","Type":"ContainerStarted","Data":"02146663ba1fbed082bae8df8c601bd487fd727f65379b9db3d780fbb855db16"}
Jul 29 19:42:16.569876 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.569857    2576 scope.go:117] "RemoveContainer" containerID="a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506"
Jul 29 19:42:16.580647 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.580619    2576 scope.go:117] "RemoveContainer" containerID="0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527"
Jul 29 19:42:16.580941 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:16.580923    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527\": container with ID starting with 0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527 not found: ID does not exist" containerID="0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527"
Jul 29 19:42:16.580998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.580950    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527"} err="failed to get container status \"0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527\": rpc error: code = NotFound desc = could not find container \"0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527\": container with ID starting with 0391bd811967d6e95ebba879d277a3a18e26dc6ed5fa04a158d8355d4369b527 not found: ID does not exist"
Jul 29 19:42:16.580998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.580968    2576 scope.go:117] "RemoveContainer" containerID="a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506"
Jul 29 19:42:16.581250 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:16.581231    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506\": container with ID starting with a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506 not found: ID does not exist" containerID="a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506"
Jul 29 19:42:16.581303 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.581256    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506"} err="failed to get container status \"a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506\": rpc error: code = NotFound desc = could not find container \"a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506\": container with ID starting with a9ef9037c719637b20e6b566368aad328c001da04f68e1c167173478c9e6e506 not found: ID does not exist"
Jul 29 19:42:16.587296 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.587248    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7" podStartSLOduration=1.587233594 podStartE2EDuration="1.587233594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:16.585305171 +0000 UTC m=+1630.481122440" watchObservedRunningTime="2026-07-29 19:42:16.587233594 +0000 UTC m=+1630.483050863"
Jul 29 19:42:16.605718 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.605667    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b" podStartSLOduration=1.605648349 podStartE2EDuration="1.605648349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:16.60481967 +0000 UTC m=+1630.500636936" watchObservedRunningTime="2026-07-29 19:42:16.605648349 +0000 UTC m=+1630.501465619"
Jul 29 19:42:16.626270 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.626232    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"]
Jul 29 19:42:16.632829 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.632789    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c5c29115-openshift-default-5b855d754-qhwxh"]
Jul 29 19:42:16.715715 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:16.715631    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7654b1b5-3e29-4869-9c29-460c15582142" path="/var/lib/kubelet/pods/7654b1b5-3e29-4869-9c29-460c15582142/volumes"
Jul 29 19:42:17.572554 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:17.572505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd" event={"ID":"26e5a8a7-6483-4405-b459-779ffa83fdba","Type":"ContainerStarted","Data":"33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5"}
Jul 29 19:42:17.591114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:17.591059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd" podStartSLOduration=2.020119647 podStartE2EDuration="2.591042908s" totalImagesPullingTime="570.923261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:17.59005718 +0000 UTC m=+1631.485874451" watchObservedRunningTime="2026-07-29 19:42:17.591042908 +0000 UTC m=+1631.486860177"
Jul 29 19:42:18.578140 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:18.578111    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:24.592337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:24.592295    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:27.574753 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:27.574716    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:27.575145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:27.574900    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:29.548003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.547968    2576 patch_prober.go:28] interesting pod/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:42:29.548513 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.548030    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:42:29.642742 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.642706    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerID="123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac" exitCode=0
Jul 29 19:42:29.642918 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.642779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" event={"ID":"ea9c5e0e-3f86-4864-af30-165e664d6eec","Type":"ContainerDied","Data":"123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac"}
Jul 29 19:42:29.643177 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.643161    2576 scope.go:117] "RemoveContainer" containerID="123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac"
Jul 29 19:42:29.644216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.644187    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:29.644288 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.644271    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:29.644336 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:29.644316    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:30.668226 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:30.668189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" event={"ID":"ea9c5e0e-3f86-4864-af30-165e664d6eec","Type":"ContainerStarted","Data":"772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996"}
Jul 29 19:42:31.397201 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:31.397153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:31.397461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:31.397436    2576 patch_prober.go:28] interesting pod/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:42:31.397585 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:31.397495    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:42:32.397762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:32.397717    2576 patch_prober.go:28] interesting pod/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:42:32.398162 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:32.397781    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:42:33.398059 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:33.398019    2576 patch_prober.go:28] interesting pod/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:42:33.398479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:33.398077    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:42:34.397937 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:34.397899    2576 patch_prober.go:28] interesting pod/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:42:34.398118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:34.397962    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:42:35.401602 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:35.401572    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:35.402070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:35.401969    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:35.402768 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:35.402748    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:45.768926 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.768877    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"]
Jul 29 19:42:45.769770 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.769163    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd" podUID="26e5a8a7-6483-4405-b459-779ffa83fdba" containerName="maas-api" containerID="cri-o://33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5" gracePeriod=30
Jul 29 19:42:45.802139 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.802103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:45.838777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.838732    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"]
Jul 29 19:42:45.839038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.838982    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b" podUID="c4c30142-6232-4edd-92e2-13876aea14dc" containerName="payload-processing" containerID="cri-o://4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1" gracePeriod=30
Jul 29 19:42:45.844003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.843973    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"]
Jul 29 19:42:45.844240 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.844194    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7" podUID="a5dd1f28-100d-4d35-ac97-617fc349d5f4" containerName="payload-pre-processing" containerID="cri-o://078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5" gracePeriod=30
Jul 29 19:42:45.883956 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.883918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:45.952149 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:45.952062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:46.029770 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.025023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:46.102294 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.102267    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:46.153386 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.153353    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:46.153596 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.153351    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"]
Jul 29 19:42:46.153695 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.153668    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy" containerID="cri-o://772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996" gracePeriod=30
Jul 29 19:42:46.170352 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.170328    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:46.174912 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.174855    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:46.242604 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.242568    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l52xb\" (UniqueName: \"kubernetes.io/projected/c4c30142-6232-4edd-92e2-13876aea14dc-kube-api-access-l52xb\") pod \"c4c30142-6232-4edd-92e2-13876aea14dc\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") "
Jul 29 19:42:46.242820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.242644    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls\") pod \"26e5a8a7-6483-4405-b459-779ffa83fdba\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") "
Jul 29 19:42:46.242820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.242672    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26e5a8a7-6483-4405-b459-779ffa83fdba-openshift-service-ca\") pod \"26e5a8a7-6483-4405-b459-779ffa83fdba\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") "
Jul 29 19:42:46.242820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.242702    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv85n\" (UniqueName: \"kubernetes.io/projected/26e5a8a7-6483-4405-b459-779ffa83fdba-kube-api-access-nv85n\") pod \"26e5a8a7-6483-4405-b459-779ffa83fdba\" (UID: \"26e5a8a7-6483-4405-b459-779ffa83fdba\") "
Jul 29 19:42:46.243237 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.243137    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26e5a8a7-6483-4405-b459-779ffa83fdba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26e5a8a7-6483-4405-b459-779ffa83fdba" (UID: "26e5a8a7-6483-4405-b459-779ffa83fdba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:46.243237 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.243165    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c30142-6232-4edd-92e2-13876aea14dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4c30142-6232-4edd-92e2-13876aea14dc" (UID: "c4c30142-6232-4edd-92e2-13876aea14dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:46.243414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.242734    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c30142-6232-4edd-92e2-13876aea14dc-plugins-config-volume\") pod \"c4c30142-6232-4edd-92e2-13876aea14dc\" (UID: \"c4c30142-6232-4edd-92e2-13876aea14dc\") "
Jul 29 19:42:46.243736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.243714    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26e5a8a7-6483-4405-b459-779ffa83fdba-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:46.243845 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.243739    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c30142-6232-4edd-92e2-13876aea14dc-plugins-config-volume\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:46.245145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.245121    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26e5a8a7-6483-4405-b459-779ffa83fdba" (UID: "26e5a8a7-6483-4405-b459-779ffa83fdba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:42:46.245444 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.245419    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e5a8a7-6483-4405-b459-779ffa83fdba-kube-api-access-nv85n" (OuterVolumeSpecName: "kube-api-access-nv85n") pod "26e5a8a7-6483-4405-b459-779ffa83fdba" (UID: "26e5a8a7-6483-4405-b459-779ffa83fdba"). InnerVolumeSpecName "kube-api-access-nv85n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:46.245515 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.245453    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4c30142-6232-4edd-92e2-13876aea14dc-kube-api-access-l52xb" (OuterVolumeSpecName: "kube-api-access-l52xb") pod "c4c30142-6232-4edd-92e2-13876aea14dc" (UID: "c4c30142-6232-4edd-92e2-13876aea14dc"). InnerVolumeSpecName "kube-api-access-l52xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:46.344510 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.344415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmwhn\" (UniqueName: \"kubernetes.io/projected/a5dd1f28-100d-4d35-ac97-617fc349d5f4-kube-api-access-lmwhn\") pod \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") "
Jul 29 19:42:46.344510 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.344458    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd1f28-100d-4d35-ac97-617fc349d5f4-plugins-config-volume\") pod \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\" (UID: \"a5dd1f28-100d-4d35-ac97-617fc349d5f4\") "
Jul 29 19:42:46.344821 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.344803    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26e5a8a7-6483-4405-b459-779ffa83fdba-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:46.344884 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.344829    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv85n\" (UniqueName: \"kubernetes.io/projected/26e5a8a7-6483-4405-b459-779ffa83fdba-kube-api-access-nv85n\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:46.344884 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.344844    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l52xb\" (UniqueName: \"kubernetes.io/projected/c4c30142-6232-4edd-92e2-13876aea14dc-kube-api-access-l52xb\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:46.344884 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.344840    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5dd1f28-100d-4d35-ac97-617fc349d5f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a5dd1f28-100d-4d35-ac97-617fc349d5f4" (UID: "a5dd1f28-100d-4d35-ac97-617fc349d5f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:46.346514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.346494    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5dd1f28-100d-4d35-ac97-617fc349d5f4-kube-api-access-lmwhn" (OuterVolumeSpecName: "kube-api-access-lmwhn") pod "a5dd1f28-100d-4d35-ac97-617fc349d5f4" (UID: "a5dd1f28-100d-4d35-ac97-617fc349d5f4"). InnerVolumeSpecName "kube-api-access-lmwhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:46.390995 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.390963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:46.445538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.445494    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmwhn\" (UniqueName: \"kubernetes.io/projected/a5dd1f28-100d-4d35-ac97-617fc349d5f4-kube-api-access-lmwhn\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:46.445538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.445531    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd1f28-100d-4d35-ac97-617fc349d5f4-plugins-config-volume\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:46.613303 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.613215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:46.753695 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.753658    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5dd1f28-100d-4d35-ac97-617fc349d5f4" containerID="078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5" exitCode=0
Jul 29 19:42:46.753885 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.753706    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"
Jul 29 19:42:46.753885 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.753743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7" event={"ID":"a5dd1f28-100d-4d35-ac97-617fc349d5f4","Type":"ContainerDied","Data":"078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5"}
Jul 29 19:42:46.753885 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.753797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7" event={"ID":"a5dd1f28-100d-4d35-ac97-617fc349d5f4","Type":"ContainerDied","Data":"eddc184f1df6404a88b048df2ef11c19bea4e35ec43c683583b45a74dff7a916"}
Jul 29 19:42:46.753885 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.753825    2576 scope.go:117] "RemoveContainer" containerID="078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5"
Jul 29 19:42:46.755260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.755236    2576 generic.go:356] "Generic (PLEG): container finished" podID="c4c30142-6232-4edd-92e2-13876aea14dc" containerID="4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1" exitCode=0
Jul 29 19:42:46.755398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.755290    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"
Jul 29 19:42:46.755398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.755331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b" event={"ID":"c4c30142-6232-4edd-92e2-13876aea14dc","Type":"ContainerDied","Data":"4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1"}
Jul 29 19:42:46.755398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.755382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b" event={"ID":"c4c30142-6232-4edd-92e2-13876aea14dc","Type":"ContainerDied","Data":"1671528b32e6e0a663dafb406ec9a18fb5ed275ab5f328d65959f803fd9a9d8a"}
Jul 29 19:42:46.756859 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.756840    2576 generic.go:356] "Generic (PLEG): container finished" podID="26e5a8a7-6483-4405-b459-779ffa83fdba" containerID="33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5" exitCode=0
Jul 29 19:42:46.756988 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.756886    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"
Jul 29 19:42:46.756988 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.756885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd" event={"ID":"26e5a8a7-6483-4405-b459-779ffa83fdba","Type":"ContainerDied","Data":"33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5"}
Jul 29 19:42:46.757104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.757000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd" event={"ID":"26e5a8a7-6483-4405-b459-779ffa83fdba","Type":"ContainerDied","Data":"02146663ba1fbed082bae8df8c601bd487fd727f65379b9db3d780fbb855db16"}
Jul 29 19:42:46.763794 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.763775    2576 scope.go:117] "RemoveContainer" containerID="078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5"
Jul 29 19:42:46.764098 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:46.764078    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5\": container with ID starting with 078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5 not found: ID does not exist" containerID="078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5"
Jul 29 19:42:46.764161 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.764109    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5"} err="failed to get container status \"078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5\": rpc error: code = NotFound desc = could not find container \"078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5\": container with ID starting with 078c5bf8cb230f06fb2302858274495a39ad9d4a5cc9f89069cf3039adcb98b5 not found: ID does not exist"
Jul 29 19:42:46.764161 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.764126    2576 scope.go:117] "RemoveContainer" containerID="4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1"
Jul 29 19:42:46.772440 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.772261    2576 scope.go:117] "RemoveContainer" containerID="4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1"
Jul 29 19:42:46.772716 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:46.772501    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1\": container with ID starting with 4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1 not found: ID does not exist" containerID="4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1"
Jul 29 19:42:46.772716 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.772523    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1"} err="failed to get container status \"4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1\": rpc error: code = NotFound desc = could not find container \"4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1\": container with ID starting with 4b3221ffec28437de1c366fdb0f72341d982d017e05d543fe9911ab7b3d0bfc1 not found: ID does not exist"
Jul 29 19:42:46.772716 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.772537    2576 scope.go:117] "RemoveContainer" containerID="33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5"
Jul 29 19:42:46.776646 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.776621    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"]
Jul 29 19:42:46.781118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.781096    2576 scope.go:117] "RemoveContainer" containerID="33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5"
Jul 29 19:42:46.781286 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.781265    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57a0d2c8-6d59987865-t4w7b"]
Jul 29 19:42:46.781430 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:46.781411    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5\": container with ID starting with 33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5 not found: ID does not exist" containerID="33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5"
Jul 29 19:42:46.781491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.781439    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5"} err="failed to get container status \"33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5\": rpc error: code = NotFound desc = could not find container \"33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5\": container with ID starting with 33d6bf0043cb52caebb04598a7797205ed47a6603752c9048acfa7e9043b21f5 not found: ID does not exist"
Jul 29 19:42:46.792068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.792037    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"]
Jul 29 19:42:46.796977 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.796948    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57a0d2c8-76d4745f46-nnrwd"]
Jul 29 19:42:46.808675 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.808640    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"]
Jul 29 19:42:46.810830 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.810805    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57a0d2c8-65d4dd4f9b-xzgf7"]
Jul 29 19:42:46.926358 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.926280    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"]
Jul 29 19:42:46.927199 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927164    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5dd1f28-100d-4d35-ac97-617fc349d5f4" containerName="payload-pre-processing"
Jul 29 19:42:46.927199 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927193    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5dd1f28-100d-4d35-ac97-617fc349d5f4" containerName="payload-pre-processing"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927207    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e5a8a7-6483-4405-b459-779ffa83fdba" containerName="maas-api"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927217    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e5a8a7-6483-4405-b459-779ffa83fdba" containerName="maas-api"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927248    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c30142-6232-4edd-92e2-13876aea14dc" containerName="payload-processing"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927258    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c30142-6232-4edd-92e2-13876aea14dc" containerName="payload-processing"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927286    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927295    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927341    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy"
Jul 29 19:42:46.927414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927350    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy"
Jul 29 19:42:46.927843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927536    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4c30142-6232-4edd-92e2-13876aea14dc" containerName="payload-processing"
Jul 29 19:42:46.927843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927582    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5dd1f28-100d-4d35-ac97-617fc349d5f4" containerName="payload-pre-processing"
Jul 29 19:42:46.927843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927593    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy"
Jul 29 19:42:46.927843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927612    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26e5a8a7-6483-4405-b459-779ffa83fdba" containerName="maas-api"
Jul 29 19:42:46.927843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.927620    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7654b1b5-3e29-4869-9c29-460c15582142" containerName="istio-proxy"
Jul 29 19:42:46.933867 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.933841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:46.936427 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.936402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ed80512f-openshift-default-dockercfg-g9lhh\""
Jul 29 19:42:46.945590 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.945565    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"]
Jul 29 19:42:46.950735 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:46.950708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:47.049946 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.049907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:47.050279 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-podinfo\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff159ce-7875-40c2-a330-6de5c1c565f0-istiod-ca-cert\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-certs\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050416 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47z5d\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-kube-api-access-47z5d\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050453 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-credential-socket\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050490 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-socket\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050490 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-token\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050609 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-data\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.050609 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.050575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-envoy\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.151620 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-certs\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.151833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47z5d\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-kube-api-access-47z5d\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.151833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-credential-socket\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.151833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-socket\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.151833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-token\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.151833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-data\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.151833 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-envoy\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.152153 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-podinfo\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.152153 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.151883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff159ce-7875-40c2-a330-6de5c1c565f0-istiod-ca-cert\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.152153 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.152006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-certs\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.152153 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.152062    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-credential-socket\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.152153 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.152117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-socket\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.152307 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.152199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-data\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.152539 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.152518    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff159ce-7875-40c2-a330-6de5c1c565f0-istiod-ca-cert\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.154237 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.154215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-envoy\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.154487 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.154469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-podinfo\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.160970 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.160940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47z5d\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-kube-api-access-47z5d\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.161104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.161090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-token\") pod \"e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") " pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.244982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.244871    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:47.391476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.391448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"]
Jul 29 19:42:47.393037 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:42:47.393008    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff159ce_7875_40c2_a330_6de5c1c565f0.slice/crio-dda07e53ea0d0c9ce79ba01927d5bda537fbe46bacb5c02b834a660ec0222729 WatchSource:0}: Error finding container dda07e53ea0d0c9ce79ba01927d5bda537fbe46bacb5c02b834a660ec0222729: Status 404 returned error can't find the container with id dda07e53ea0d0c9ce79ba01927d5bda537fbe46bacb5c02b834a660ec0222729
Jul 29 19:42:47.395133 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.395105    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:47.395190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.395167    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:47.395226 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.395193    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:42:47.765062 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.765028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" event={"ID":"0ff159ce-7875-40c2-a330-6de5c1c565f0","Type":"ContainerStarted","Data":"63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086"}
Jul 29 19:42:47.765238 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.765086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" event={"ID":"0ff159ce-7875-40c2-a330-6de5c1c565f0","Type":"ContainerStarted","Data":"dda07e53ea0d0c9ce79ba01927d5bda537fbe46bacb5c02b834a660ec0222729"}
Jul 29 19:42:47.791538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:47.791462    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podStartSLOduration=1.791444266 podStartE2EDuration="1.791444266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:47.790210779 +0000 UTC m=+1661.686028049" watchObservedRunningTime="2026-07-29 19:42:47.791444266 +0000 UTC m=+1661.687261534"
Jul 29 19:42:48.246015 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:48.245917    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:48.251130 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:48.251102    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:48.715762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:48.715732    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26e5a8a7-6483-4405-b459-779ffa83fdba" path="/var/lib/kubelet/pods/26e5a8a7-6483-4405-b459-779ffa83fdba/volumes"
Jul 29 19:42:48.716092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:48.716080    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5dd1f28-100d-4d35-ac97-617fc349d5f4" path="/var/lib/kubelet/pods/a5dd1f28-100d-4d35-ac97-617fc349d5f4/volumes"
Jul 29 19:42:48.716381 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:48.716370    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4c30142-6232-4edd-92e2-13876aea14dc" path="/var/lib/kubelet/pods/c4c30142-6232-4edd-92e2-13876aea14dc/volumes"
Jul 29 19:42:48.770941 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:48.770909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:48.772074 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:48.772050    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:42:49.167063 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.167025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:49.262699 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.262663    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:49.405593 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.405535    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"]
Jul 29 19:42:49.410118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.410097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.412617 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.412592    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ed80512f-serving-cert\""
Jul 29 19:42:49.422604 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.422515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"]
Jul 29 19:42:49.440603 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.440570    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:49.574254 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.574226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8d736c-4ef8-46a9-9258-c219f8c394f3-openshift-service-ca\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.574435 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.574270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8d736c-4ef8-46a9-9258-c219f8c394f3-maas-api-tls\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.574435 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.574360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7r4h\" (UniqueName: \"kubernetes.io/projected/5c8d736c-4ef8-46a9-9258-c219f8c394f3-kube-api-access-k7r4h\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.675075 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.674981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7r4h\" (UniqueName: \"kubernetes.io/projected/5c8d736c-4ef8-46a9-9258-c219f8c394f3-kube-api-access-k7r4h\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.675075 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.675051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8d736c-4ef8-46a9-9258-c219f8c394f3-openshift-service-ca\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.675274 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.675128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8d736c-4ef8-46a9-9258-c219f8c394f3-maas-api-tls\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.675768 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.675744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8d736c-4ef8-46a9-9258-c219f8c394f3-openshift-service-ca\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.677700 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.677676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8d736c-4ef8-46a9-9258-c219f8c394f3-maas-api-tls\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.688614 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.688583    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7r4h\" (UniqueName: \"kubernetes.io/projected/5c8d736c-4ef8-46a9-9258-c219f8c394f3-kube-api-access-k7r4h\") pod \"maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.722124 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.722081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:49.737395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.737365    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:49.877337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:49.877259    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"]
Jul 29 19:42:49.879736 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:42:49.879709    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8d736c_4ef8_46a9_9258_c219f8c394f3.slice/crio-9cf9ea18b22a0ad0b8ce6e7ac81f22dbcb1d80f394601b5ba9fda264da5b5e35 WatchSource:0}: Error finding container 9cf9ea18b22a0ad0b8ce6e7ac81f22dbcb1d80f394601b5ba9fda264da5b5e35: Status 404 returned error can't find the container with id 9cf9ea18b22a0ad0b8ce6e7ac81f22dbcb1d80f394601b5ba9fda264da5b5e35
Jul 29 19:42:50.088086 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.088047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:50.187443 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.187407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:50.274149 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.274123    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"]
Jul 29 19:42:50.278589 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.278569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.281476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.281457    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ed80512f-dockercfg-5xxcq\""
Jul 29 19:42:50.281719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.281705    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ed80512f\""
Jul 29 19:42:50.295732 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.294304    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"]
Jul 29 19:42:50.382951 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.382866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh9l4\" (UniqueName: \"kubernetes.io/projected/ce624226-bb4a-4533-b83a-3cb51b17619a-kube-api-access-zh9l4\") pod \"payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.382951 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.382937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce624226-bb4a-4533-b83a-3cb51b17619a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.404303 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.404257    2576 patch_prober.go:28] interesting pod/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 19:42:50.404476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.404335    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:42:50.484041 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.484005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh9l4\" (UniqueName: \"kubernetes.io/projected/ce624226-bb4a-4533-b83a-3cb51b17619a-kube-api-access-zh9l4\") pod \"payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.484255 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.484078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce624226-bb4a-4533-b83a-3cb51b17619a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.484822 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.484801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce624226-bb4a-4533-b83a-3cb51b17619a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.494978 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.494949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh9l4\" (UniqueName: \"kubernetes.io/projected/ce624226-bb4a-4533-b83a-3cb51b17619a-kube-api-access-zh9l4\") pod \"payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.593964 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.593924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:50.730761 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.730725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"]
Jul 29 19:42:50.734698 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:42:50.734670    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce624226_bb4a_4533_b83a_3cb51b17619a.slice/crio-862782cd861f3d95244682c242aabb9944475b0d01938c6666a875f38ff9e1e1 WatchSource:0}: Error finding container 862782cd861f3d95244682c242aabb9944475b0d01938c6666a875f38ff9e1e1: Status 404 returned error can't find the container with id 862782cd861f3d95244682c242aabb9944475b0d01938c6666a875f38ff9e1e1
Jul 29 19:42:50.784745 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.784704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b" event={"ID":"5c8d736c-4ef8-46a9-9258-c219f8c394f3","Type":"ContainerStarted","Data":"552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e"}
Jul 29 19:42:50.784930 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.784777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b" event={"ID":"5c8d736c-4ef8-46a9-9258-c219f8c394f3","Type":"ContainerStarted","Data":"9cf9ea18b22a0ad0b8ce6e7ac81f22dbcb1d80f394601b5ba9fda264da5b5e35"}
Jul 29 19:42:50.784930 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.784808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:42:50.786222 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.786191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb" event={"ID":"ce624226-bb4a-4533-b83a-3cb51b17619a","Type":"ContainerStarted","Data":"862782cd861f3d95244682c242aabb9944475b0d01938c6666a875f38ff9e1e1"}
Jul 29 19:42:50.807428 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:50.807369    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b" podStartSLOduration=1.454683651 podStartE2EDuration="1.807350593s" totalImagesPullingTime="352.666942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:50.804578249 +0000 UTC m=+1664.700395510" watchObservedRunningTime="2026-07-29 19:42:50.807350593 +0000 UTC m=+1664.703167892"
Jul 29 19:42:51.403865 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.403837    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:51.594791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594753    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-envoy\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.594791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594795    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-data\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594843    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-socket\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594866    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crfkg\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-kube-api-access-crfkg\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594887    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-credential-socket\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594919    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-podinfo\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594948    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-token\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.594995    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9c5e0e-3f86-4864-af30-165e664d6eec-istiod-ca-cert\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595120    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:51.595455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595218    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:51.595455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595244    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-certs\") pod \"ea9c5e0e-3f86-4864-af30-165e664d6eec\" (UID: \"ea9c5e0e-3f86-4864-af30-165e664d6eec\") "
Jul 29 19:42:51.595455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595341    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea9c5e0e-3f86-4864-af30-165e664d6eec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:42:51.595455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595439    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:51.595719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595578    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.595719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595597    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.595719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595612    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9c5e0e-3f86-4864-af30-165e664d6eec-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.595719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595624    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.595719 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.595691    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:51.597200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.597175    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:51.597320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.597300    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:42:51.597492 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.597466    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:42:51.597492 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.597469    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-kube-api-access-crfkg" (OuterVolumeSpecName: "kube-api-access-crfkg") pod "ea9c5e0e-3f86-4864-af30-165e664d6eec" (UID: "ea9c5e0e-3f86-4864-af30-165e664d6eec"). InnerVolumeSpecName "kube-api-access-crfkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:42:51.696206 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.696172    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crfkg\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-kube-api-access-crfkg\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.696206 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.696203    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.696206 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.696213    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.696442 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.696225    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.696442 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.696235    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9c5e0e-3f86-4864-af30-165e664d6eec-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:42:51.793206 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.793152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb" event={"ID":"ce624226-bb4a-4533-b83a-3cb51b17619a","Type":"ContainerStarted","Data":"ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035"}
Jul 29 19:42:51.793367 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.793229    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:42:51.794827 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.794802    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerID="772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996" exitCode=0
Jul 29 19:42:51.794974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.794829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" event={"ID":"ea9c5e0e-3f86-4864-af30-165e664d6eec","Type":"ContainerDied","Data":"772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996"}
Jul 29 19:42:51.794974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.794845    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"
Jul 29 19:42:51.794974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.794881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt" event={"ID":"ea9c5e0e-3f86-4864-af30-165e664d6eec","Type":"ContainerDied","Data":"def169fa7e1ebf2a2ec644b25b4625c0e54063869b3eb2be3f0e0487862396d2"}
Jul 29 19:42:51.794974 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.794902    2576 scope.go:117] "RemoveContainer" containerID="772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996"
Jul 29 19:42:51.805074 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.805047    2576 scope.go:117] "RemoveContainer" containerID="123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac"
Jul 29 19:42:51.811267 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.811215    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb" podStartSLOduration=1.811197118 podStartE2EDuration="1.811197118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:51.808665017 +0000 UTC m=+1665.704482288" watchObservedRunningTime="2026-07-29 19:42:51.811197118 +0000 UTC m=+1665.707014388"
Jul 29 19:42:51.814997 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.814977    2576 scope.go:117] "RemoveContainer" containerID="772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996"
Jul 29 19:42:51.815343 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:51.815324    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996\": container with ID starting with 772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996 not found: ID does not exist" containerID="772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996"
Jul 29 19:42:51.815384 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.815353    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996"} err="failed to get container status \"772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996\": rpc error: code = NotFound desc = could not find container \"772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996\": container with ID starting with 772af2a985420baa0c145b3d01a2218573e0be14a7ab4f1840e7365345b9e996 not found: ID does not exist"
Jul 29 19:42:51.815384 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.815372    2576 scope.go:117] "RemoveContainer" containerID="123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac"
Jul 29 19:42:51.815642 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:42:51.815623    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac\": container with ID starting with 123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac not found: ID does not exist" containerID="123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac"
Jul 29 19:42:51.815686 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.815650    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac"} err="failed to get container status \"123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac\": rpc error: code = NotFound desc = could not find container \"123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac\": container with ID starting with 123f0ff3d0a5f05384e51de7c7fd45a1233640ee0c817e6891ef39161a05c5ac not found: ID does not exist"
Jul 29 19:42:51.824647 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.824617    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"]
Jul 29 19:42:51.829870 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:51.829843    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-57a0d2c8-gw-openshift-default-594dd94888-gvxvt"]
Jul 29 19:42:52.715455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:52.715421    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" path="/var/lib/kubelet/pods/ea9c5e0e-3f86-4864-af30-165e664d6eec/volumes"
Jul 29 19:42:56.801173 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:42:56.801141    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:43:02.804715 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:02.804682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:43:03.772453 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.772416    2576 patch_prober.go:28] interesting pod/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 29 19:43:03.772732 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.772493    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 29 19:43:03.862864 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.862833    2576 generic.go:356] "Generic (PLEG): container finished" podID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerID="63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086" exitCode=0
Jul 29 19:43:03.863330 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.862904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" event={"ID":"0ff159ce-7875-40c2-a330-6de5c1c565f0","Type":"ContainerDied","Data":"63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086"}
Jul 29 19:43:03.863414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.863396    2576 scope.go:117] "RemoveContainer" containerID="63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086"
Jul 29 19:43:03.864413 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.864387    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:03.864479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.864456    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:03.864517 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:03.864489    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:04.872982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:04.872944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" event={"ID":"0ff159ce-7875-40c2-a330-6de5c1c565f0","Type":"ContainerStarted","Data":"df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62"}
Jul 29 19:43:05.245877 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:05.245771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:43:05.246278 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:05.246244    2576 patch_prober.go:28] interesting pod/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 29 19:43:05.246390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:05.246326    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 29 19:43:06.246285 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:06.246245    2576 patch_prober.go:28] interesting pod/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 29 19:43:06.246932 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:06.246896    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 29 19:43:07.245981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:07.245929    2576 patch_prober.go:28] interesting pod/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 29 19:43:07.246205 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:07.246021    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 29 19:43:08.246184 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:08.246146    2576 patch_prober.go:28] interesting pod/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 29 19:43:08.246804 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:08.246772    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 29 19:43:09.250065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:09.250033    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:43:09.250585 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:09.250446    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:43:09.251150 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:09.251130    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:43:17.457121 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:17.457086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:19.982215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:19.982178    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"]
Jul 29 19:43:19.982660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:19.982437    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b" podUID="5c8d736c-4ef8-46a9-9258-c219f8c394f3" containerName="maas-api" containerID="cri-o://552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e" gracePeriod=30
Jul 29 19:43:20.028004 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.027967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:20.123341 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.123301    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"]
Jul 29 19:43:20.123834 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.123799    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb" podUID="ce624226-bb4a-4533-b83a-3cb51b17619a" containerName="payload-pre-processing" containerID="cri-o://ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035" gracePeriod=30
Jul 29 19:43:20.150405 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.150372    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:20.250978 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.250946    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:20.254573 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.254529    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:43:20.353687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.353654    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:20.379831 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.379808    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:43:20.382746 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.382716    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7r4h\" (UniqueName: \"kubernetes.io/projected/5c8d736c-4ef8-46a9-9258-c219f8c394f3-kube-api-access-k7r4h\") pod \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") "
Jul 29 19:43:20.382893 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.382755    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8d736c-4ef8-46a9-9258-c219f8c394f3-maas-api-tls\") pod \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") "
Jul 29 19:43:20.382893 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.382810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8d736c-4ef8-46a9-9258-c219f8c394f3-openshift-service-ca\") pod \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\" (UID: \"5c8d736c-4ef8-46a9-9258-c219f8c394f3\") "
Jul 29 19:43:20.383274 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.383244    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8d736c-4ef8-46a9-9258-c219f8c394f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c8d736c-4ef8-46a9-9258-c219f8c394f3" (UID: "5c8d736c-4ef8-46a9-9258-c219f8c394f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:20.384849 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.384817    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c8d736c-4ef8-46a9-9258-c219f8c394f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c8d736c-4ef8-46a9-9258-c219f8c394f3" (UID: "5c8d736c-4ef8-46a9-9258-c219f8c394f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:43:20.384982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.384822    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c8d736c-4ef8-46a9-9258-c219f8c394f3-kube-api-access-k7r4h" (OuterVolumeSpecName: "kube-api-access-k7r4h") pod "5c8d736c-4ef8-46a9-9258-c219f8c394f3" (UID: "5c8d736c-4ef8-46a9-9258-c219f8c394f3"). InnerVolumeSpecName "kube-api-access-k7r4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:20.483433 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.483394    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce624226-bb4a-4533-b83a-3cb51b17619a-plugins-config-volume\") pod \"ce624226-bb4a-4533-b83a-3cb51b17619a\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") "
Jul 29 19:43:20.483673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.483442    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh9l4\" (UniqueName: \"kubernetes.io/projected/ce624226-bb4a-4533-b83a-3cb51b17619a-kube-api-access-zh9l4\") pod \"ce624226-bb4a-4533-b83a-3cb51b17619a\" (UID: \"ce624226-bb4a-4533-b83a-3cb51b17619a\") "
Jul 29 19:43:20.483733 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.483705    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7r4h\" (UniqueName: \"kubernetes.io/projected/5c8d736c-4ef8-46a9-9258-c219f8c394f3-kube-api-access-k7r4h\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:20.483733 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.483725    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8d736c-4ef8-46a9-9258-c219f8c394f3-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:20.483804 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.483738    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8d736c-4ef8-46a9-9258-c219f8c394f3-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:20.483840 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.483792    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce624226-bb4a-4533-b83a-3cb51b17619a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce624226-bb4a-4533-b83a-3cb51b17619a" (UID: "ce624226-bb4a-4533-b83a-3cb51b17619a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:20.485565 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.485530    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce624226-bb4a-4533-b83a-3cb51b17619a-kube-api-access-zh9l4" (OuterVolumeSpecName: "kube-api-access-zh9l4") pod "ce624226-bb4a-4533-b83a-3cb51b17619a" (UID: "ce624226-bb4a-4533-b83a-3cb51b17619a"). InnerVolumeSpecName "kube-api-access-zh9l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:20.584183 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.584135    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce624226-bb4a-4533-b83a-3cb51b17619a-plugins-config-volume\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:20.584183 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.584173    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh9l4\" (UniqueName: \"kubernetes.io/projected/ce624226-bb4a-4533-b83a-3cb51b17619a-kube-api-access-zh9l4\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:20.958024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.957992    2576 generic.go:356] "Generic (PLEG): container finished" podID="5c8d736c-4ef8-46a9-9258-c219f8c394f3" containerID="552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e" exitCode=0
Jul 29 19:43:20.958212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.958033    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"
Jul 29 19:43:20.958212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.958064    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b" event={"ID":"5c8d736c-4ef8-46a9-9258-c219f8c394f3","Type":"ContainerDied","Data":"552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e"}
Jul 29 19:43:20.958212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.958117    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b" event={"ID":"5c8d736c-4ef8-46a9-9258-c219f8c394f3","Type":"ContainerDied","Data":"9cf9ea18b22a0ad0b8ce6e7ac81f22dbcb1d80f394601b5ba9fda264da5b5e35"}
Jul 29 19:43:20.958212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.958149    2576 scope.go:117] "RemoveContainer" containerID="552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e"
Jul 29 19:43:20.959470 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.959446    2576 generic.go:356] "Generic (PLEG): container finished" podID="ce624226-bb4a-4533-b83a-3cb51b17619a" containerID="ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035" exitCode=0
Jul 29 19:43:20.959581 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.959511    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"
Jul 29 19:43:20.959643 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.959573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb" event={"ID":"ce624226-bb4a-4533-b83a-3cb51b17619a","Type":"ContainerDied","Data":"ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035"}
Jul 29 19:43:20.959702 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.959641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb" event={"ID":"ce624226-bb4a-4533-b83a-3cb51b17619a","Type":"ContainerDied","Data":"862782cd861f3d95244682c242aabb9944475b0d01938c6666a875f38ff9e1e1"}
Jul 29 19:43:20.966907 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.966888    2576 scope.go:117] "RemoveContainer" containerID="552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e"
Jul 29 19:43:20.967181 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:43:20.967162    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e\": container with ID starting with 552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e not found: ID does not exist" containerID="552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e"
Jul 29 19:43:20.967231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.967189    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e"} err="failed to get container status \"552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e\": rpc error: code = NotFound desc = could not find container \"552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e\": container with ID starting with 552b899cf75dfcd755d55db982f58b4e1e1efdd31fb524e57d62f0daf2d7d56e not found: ID does not exist"
Jul 29 19:43:20.967231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.967204    2576 scope.go:117] "RemoveContainer" containerID="ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035"
Jul 29 19:43:20.975378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.975355    2576 scope.go:117] "RemoveContainer" containerID="ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035"
Jul 29 19:43:20.975970 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:43:20.975941    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035\": container with ID starting with ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035 not found: ID does not exist" containerID="ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035"
Jul 29 19:43:20.976073 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.975977    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035"} err="failed to get container status \"ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035\": rpc error: code = NotFound desc = could not find container \"ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035\": container with ID starting with ecef552338c3684903872c72ead7c09c1ef251b34affe90c2ece2cedadc15035 not found: ID does not exist"
Jul 29 19:43:20.978082 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.978063    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"]
Jul 29 19:43:20.985212 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.985188    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed80512f-7999465cb4-7nn9b"]
Jul 29 19:43:20.996943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:20.996915    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"]
Jul 29 19:43:21.001449 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:21.001423    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ed80512f-5f4d667548-5d2rb"]
Jul 29 19:43:21.494673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:21.494638    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"]
Jul 29 19:43:21.494871 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:21.494849    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy" containerID="cri-o://df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62" gracePeriod=30
Jul 29 19:43:21.520842 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:21.520812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:21.698585 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:21.698521    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:21.909846 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:21.909807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:22.198840 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.198756    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"]
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199100    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c8d736c-4ef8-46a9-9258-c219f8c394f3" containerName="maas-api"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199112    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c8d736c-4ef8-46a9-9258-c219f8c394f3" containerName="maas-api"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199126    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce624226-bb4a-4533-b83a-3cb51b17619a" containerName="payload-pre-processing"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199131    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce624226-bb4a-4533-b83a-3cb51b17619a" containerName="payload-pre-processing"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199141    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199147    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199199    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199205    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy"
Jul 29 19:43:22.199210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199214    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c8d736c-4ef8-46a9-9258-c219f8c394f3" containerName="maas-api"
Jul 29 19:43:22.199535 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.199221    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce624226-bb4a-4533-b83a-3cb51b17619a" containerName="payload-pre-processing"
Jul 29 19:43:22.203626 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.203607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.206685 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.206658    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-01750ee0-openshift-default-dockercfg-vc6dk\""
Jul 29 19:43:22.224576 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.224521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"]
Jul 29 19:43:22.234136 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.234097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:22.299190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-socket\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299394 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-credential-socket\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299394 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-certs\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299394 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv6ls\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-kube-api-access-sv6ls\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299394 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299364    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8ee9171-0628-4d79-9284-3aea69910756-istio-podinfo\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-istio-token\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8ee9171-0628-4d79-9284-3aea69910756-istiod-ca-cert\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299703 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-envoy\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.299703 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.299650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-data\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400078 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-istio-token\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400078 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8ee9171-0628-4d79-9284-3aea69910756-istiod-ca-cert\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-envoy\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-data\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-socket\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-credential-socket\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400540 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-certs\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400540 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6ls\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-kube-api-access-sv6ls\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400540 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8ee9171-0628-4d79-9284-3aea69910756-istio-podinfo\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400730    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-data\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-certs\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.400875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-credential-socket\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.401005 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.400981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-socket\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.401119 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.401060    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8ee9171-0628-4d79-9284-3aea69910756-istiod-ca-cert\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.402587 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.402570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-envoy\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.403029 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.403011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8ee9171-0628-4d79-9284-3aea69910756-istio-podinfo\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.414470 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.414441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-istio-token\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.414747 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.414722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv6ls\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-kube-api-access-sv6ls\") pod \"e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") " pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.414896 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.414829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:22.515031 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.514990    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:22.658631 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.658605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"]
Jul 29 19:43:22.660502 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:43:22.660477    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ee9171_0628_4d79_9284_3aea69910756.slice/crio-9c04c53b8059610ee60e9d0c13a9665b2d70cdd075c1e2234971b81d6f0c872f WatchSource:0}: Error finding container 9c04c53b8059610ee60e9d0c13a9665b2d70cdd075c1e2234971b81d6f0c872f: Status 404 returned error can't find the container with id 9c04c53b8059610ee60e9d0c13a9665b2d70cdd075c1e2234971b81d6f0c872f
Jul 29 19:43:22.662649 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.662616    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:22.662740 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.662684    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:22.662740 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.662714    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:22.715080 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.715051    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c8d736c-4ef8-46a9-9258-c219f8c394f3" path="/var/lib/kubelet/pods/5c8d736c-4ef8-46a9-9258-c219f8c394f3/volumes"
Jul 29 19:43:22.715437 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.715423    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce624226-bb4a-4533-b83a-3cb51b17619a" path="/var/lib/kubelet/pods/ce624226-bb4a-4533-b83a-3cb51b17619a/volumes"
Jul 29 19:43:22.974205 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.974103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" event={"ID":"c8ee9171-0628-4d79-9284-3aea69910756","Type":"ContainerStarted","Data":"53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab"}
Jul 29 19:43:22.974205 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:22.974160    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" event={"ID":"c8ee9171-0628-4d79-9284-3aea69910756","Type":"ContainerStarted","Data":"9c04c53b8059610ee60e9d0c13a9665b2d70cdd075c1e2234971b81d6f0c872f"}
Jul 29 19:43:23.001957 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:23.001897    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" podStartSLOduration=1.001879575 podStartE2EDuration="1.001879575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:43:22.999029894 +0000 UTC m=+1696.894847165" watchObservedRunningTime="2026-07-29 19:43:23.001879575 +0000 UTC m=+1696.897696844"
Jul 29 19:43:23.515661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:23.515624    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:23.520576 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:23.520525    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:23.979672 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:23.979586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:23.980502 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:23.980484    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:24.252591 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.252481    2576 patch_prober.go:28] interesting pod/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 19:43:24.252591 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.252538    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:43:24.466428 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.466386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:24.607894 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.607860    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"]
Jul 29 19:43:24.608265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.608222    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy"
Jul 29 19:43:24.608265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.608235    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9c5e0e-3f86-4864-af30-165e664d6eec" containerName="istio-proxy"
Jul 29 19:43:24.611346 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.611327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.613485 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.613468    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-01750ee0-serving-cert\""
Jul 29 19:43:24.657843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.657805    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"]
Jul 29 19:43:24.661678 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.661630    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:24.721213 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.721182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f693be7-7e15-4399-b6a7-313b80ef5d57-openshift-service-ca\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.721396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.721269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnzt\" (UniqueName: \"kubernetes.io/projected/9f693be7-7e15-4399-b6a7-313b80ef5d57-kube-api-access-gnnzt\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.721396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.721335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f693be7-7e15-4399-b6a7-313b80ef5d57-maas-api-tls\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.822118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.822087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f693be7-7e15-4399-b6a7-313b80ef5d57-maas-api-tls\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.822268 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.822127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f693be7-7e15-4399-b6a7-313b80ef5d57-openshift-service-ca\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.822268 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.822197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnzt\" (UniqueName: \"kubernetes.io/projected/9f693be7-7e15-4399-b6a7-313b80ef5d57-kube-api-access-gnnzt\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.822820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.822792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f693be7-7e15-4399-b6a7-313b80ef5d57-openshift-service-ca\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.824455 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.824433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f693be7-7e15-4399-b6a7-313b80ef5d57-maas-api-tls\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.836670 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.836641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnzt\" (UniqueName: \"kubernetes.io/projected/9f693be7-7e15-4399-b6a7-313b80ef5d57-kube-api-access-gnnzt\") pod \"maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.921687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.921592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:24.928464 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:24.928439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:25.070180 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:25.070149    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"]
Jul 29 19:43:25.071469 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:43:25.071442    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f693be7_7e15_4399_b6a7_313b80ef5d57.slice/crio-c89ff2eb5c5212a4cda5fc8773d4e0219f650a1d38af9cd9d1a5c36d88a56131 WatchSource:0}: Error finding container c89ff2eb5c5212a4cda5fc8773d4e0219f650a1d38af9cd9d1a5c36d88a56131: Status 404 returned error can't find the container with id c89ff2eb5c5212a4cda5fc8773d4e0219f650a1d38af9cd9d1a5c36d88a56131
Jul 29 19:43:25.071966 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:25.071920    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:25.678227 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:25.678186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:25.782231 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:25.782174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:25.993691 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:25.993657    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4" event={"ID":"9f693be7-7e15-4399-b6a7-313b80ef5d57","Type":"ContainerStarted","Data":"30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a"}
Jul 29 19:43:25.993900 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:25.993878    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:25.993971 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:25.993920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4" event={"ID":"9f693be7-7e15-4399-b6a7-313b80ef5d57","Type":"ContainerStarted","Data":"c89ff2eb5c5212a4cda5fc8773d4e0219f650a1d38af9cd9d1a5c36d88a56131"}
Jul 29 19:43:26.026349 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.026281    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4" podStartSLOduration=1.663479804 podStartE2EDuration="2.026260403s" totalImagesPullingTime="362.780599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:43:26.023383824 +0000 UTC m=+1699.919201114" watchObservedRunningTime="2026-07-29 19:43:26.026260403 +0000 UTC m=+1699.922077717"
Jul 29 19:43:26.763399 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.763338    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:43:26.943112 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943080    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-credential-socket\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943124    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-envoy\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff159ce-7875-40c2-a330-6de5c1c565f0-istiod-ca-cert\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943169    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-data\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943183    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-socket\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943203    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-certs\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-token\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943369    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47z5d\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-kube-api-access-47z5d\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943442    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-podinfo\") pod \"0ff159ce-7875-40c2-a330-6de5c1c565f0\" (UID: \"0ff159ce-7875-40c2-a330-6de5c1c565f0\") "
Jul 29 19:43:26.943697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943479    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:26.943697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943623    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:26.943917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943772    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff159ce-7875-40c2-a330-6de5c1c565f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:26.943917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943787    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:26.943917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943809    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:26.944143 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.943962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:26.944597 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.944575    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:26.945711 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.945683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:43:26.945817 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.945745    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:26.946056 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.946035    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:26.946135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:26.946062    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-kube-api-access-47z5d" (OuterVolumeSpecName: "kube-api-access-47z5d") pod "0ff159ce-7875-40c2-a330-6de5c1c565f0" (UID: "0ff159ce-7875-40c2-a330-6de5c1c565f0"). InnerVolumeSpecName "kube-api-access-47z5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:27.000082 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.000045    2576 generic.go:356] "Generic (PLEG): container finished" podID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerID="df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62" exitCode=0
Jul 29 19:43:27.000251 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.000098    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"
Jul 29 19:43:27.000251 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.000125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" event={"ID":"0ff159ce-7875-40c2-a330-6de5c1c565f0","Type":"ContainerDied","Data":"df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62"}
Jul 29 19:43:27.000251 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.000210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89" event={"ID":"0ff159ce-7875-40c2-a330-6de5c1c565f0","Type":"ContainerDied","Data":"dda07e53ea0d0c9ce79ba01927d5bda537fbe46bacb5c02b834a660ec0222729"}
Jul 29 19:43:27.000251 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.000234    2576 scope.go:117] "RemoveContainer" containerID="df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62"
Jul 29 19:43:27.009949 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.009929    2576 scope.go:117] "RemoveContainer" containerID="63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086"
Jul 29 19:43:27.019102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.019004    2576 scope.go:117] "RemoveContainer" containerID="df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62"
Jul 29 19:43:27.019255 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:43:27.019233    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62\": container with ID starting with df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62 not found: ID does not exist" containerID="df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62"
Jul 29 19:43:27.019314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.019268    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62"} err="failed to get container status \"df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62\": rpc error: code = NotFound desc = could not find container \"df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62\": container with ID starting with df67dc14177f8308a4cf1692d3b4899afad8363876cd8038e8ccbac649fefe62 not found: ID does not exist"
Jul 29 19:43:27.019314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.019292    2576 scope.go:117] "RemoveContainer" containerID="63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086"
Jul 29 19:43:27.019573 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:43:27.019531    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086\": container with ID starting with 63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086 not found: ID does not exist" containerID="63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086"
Jul 29 19:43:27.019642 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.019582    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086"} err="failed to get container status \"63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086\": rpc error: code = NotFound desc = could not find container \"63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086\": container with ID starting with 63d0cedd7a16f1c2e9314a3e8321fdbf4be79501e28f80ad5eb15f8821727086 not found: ID does not exist"
Jul 29 19:43:27.025623 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.025599    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"]
Jul 29 19:43:27.030755 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.030728    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ed80512f-openshift-default-7cbcf95486-h8s89"]
Jul 29 19:43:27.045048 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.045019    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:27.045048 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.045047    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47z5d\" (UniqueName: \"kubernetes.io/projected/0ff159ce-7875-40c2-a330-6de5c1c565f0-kube-api-access-47z5d\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:27.045216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.045057    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:27.045216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.045067    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:27.045216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.045076    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff159ce-7875-40c2-a330-6de5c1c565f0-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:27.045216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.045083    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:27.045216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:27.045090    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff159ce-7875-40c2-a330-6de5c1c565f0-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:28.715759 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:28.715681    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" path="/var/lib/kubelet/pods/0ff159ce-7875-40c2-a330-6de5c1c565f0/volumes"
Jul 29 19:43:32.006312 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:32.006282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:38.083519 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:38.083486    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8ee9171-0628-4d79-9284-3aea69910756" containerID="53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab" exitCode=0
Jul 29 19:43:38.083961 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:38.083577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" event={"ID":"c8ee9171-0628-4d79-9284-3aea69910756","Type":"ContainerDied","Data":"53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab"}
Jul 29 19:43:38.084026 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:38.083969    2576 scope.go:117] "RemoveContainer" containerID="53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab"
Jul 29 19:43:38.084963 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:38.084935    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:38.085038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:38.085003    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:38.085038 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:38.085031    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:43:38.980507 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:38.980471    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:39.091172 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:39.091132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" event={"ID":"c8ee9171-0628-4d79-9284-3aea69910756","Type":"ContainerStarted","Data":"2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf"}
Jul 29 19:43:39.515770 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:39.515737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:39.516877 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:39.516852    2576 patch_prober.go:28] interesting pod/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 29 19:43:39.516989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:39.516914    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 29 19:43:40.515647 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:40.515607    2576 patch_prober.go:28] interesting pod/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 29 19:43:40.516047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:40.515672    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 29 19:43:41.515581 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:41.515529    2576 patch_prober.go:28] interesting pod/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 29 19:43:41.515796 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:41.515605    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 29 19:43:42.515762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:42.515726    2576 patch_prober.go:28] interesting pod/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 29 19:43:42.515940 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:42.515780    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 29 19:43:43.520049 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:43.520014    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:43.520510 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:43.520298    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:43.521135 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:43.521118    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:43:55.333645 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.333594    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"]
Jul 29 19:43:55.334221 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.333910    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4" podUID="9f693be7-7e15-4399-b6a7-313b80ef5d57" containerName="maas-api" containerID="cri-o://30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a" gracePeriod=30
Jul 29 19:43:55.415731 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.415701    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:55.510285 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.510252    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:55.586217 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.586151    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:55.619174 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.619145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:55.704729 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.704695    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f693be7-7e15-4399-b6a7-313b80ef5d57-maas-api-tls\") pod \"9f693be7-7e15-4399-b6a7-313b80ef5d57\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") "
Jul 29 19:43:55.704915 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.704776    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f693be7-7e15-4399-b6a7-313b80ef5d57-openshift-service-ca\") pod \"9f693be7-7e15-4399-b6a7-313b80ef5d57\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") "
Jul 29 19:43:55.704915 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.704817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnnzt\" (UniqueName: \"kubernetes.io/projected/9f693be7-7e15-4399-b6a7-313b80ef5d57-kube-api-access-gnnzt\") pod \"9f693be7-7e15-4399-b6a7-313b80ef5d57\" (UID: \"9f693be7-7e15-4399-b6a7-313b80ef5d57\") "
Jul 29 19:43:55.705139 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.705114    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f693be7-7e15-4399-b6a7-313b80ef5d57-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f693be7-7e15-4399-b6a7-313b80ef5d57" (UID: "9f693be7-7e15-4399-b6a7-313b80ef5d57"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:55.707799 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.707762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f693be7-7e15-4399-b6a7-313b80ef5d57-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f693be7-7e15-4399-b6a7-313b80ef5d57" (UID: "9f693be7-7e15-4399-b6a7-313b80ef5d57"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:43:55.709103 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.709056    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f693be7-7e15-4399-b6a7-313b80ef5d57-kube-api-access-gnnzt" (OuterVolumeSpecName: "kube-api-access-gnnzt") pod "9f693be7-7e15-4399-b6a7-313b80ef5d57" (UID: "9f693be7-7e15-4399-b6a7-313b80ef5d57"). InnerVolumeSpecName "kube-api-access-gnnzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:55.740406 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.740364    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"]
Jul 29 19:43:55.740673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.740647    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy" containerID="cri-o://2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf" gracePeriod=30
Jul 29 19:43:55.805980 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.805939    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f693be7-7e15-4399-b6a7-313b80ef5d57-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:55.805980 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.805975    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnnzt\" (UniqueName: \"kubernetes.io/projected/9f693be7-7e15-4399-b6a7-313b80ef5d57-kube-api-access-gnnzt\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:55.805980 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.805990    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f693be7-7e15-4399-b6a7-313b80ef5d57-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:43:55.806869 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:55.806839    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.000531 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.000430    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.178332 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.178294    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f693be7-7e15-4399-b6a7-313b80ef5d57" containerID="30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a" exitCode=0
Jul 29 19:43:56.178332 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.178337    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"
Jul 29 19:43:56.178564 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.178338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4" event={"ID":"9f693be7-7e15-4399-b6a7-313b80ef5d57","Type":"ContainerDied","Data":"30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a"}
Jul 29 19:43:56.178564 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.178466    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4" event={"ID":"9f693be7-7e15-4399-b6a7-313b80ef5d57","Type":"ContainerDied","Data":"c89ff2eb5c5212a4cda5fc8773d4e0219f650a1d38af9cd9d1a5c36d88a56131"}
Jul 29 19:43:56.178564 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.178496    2576 scope.go:117] "RemoveContainer" containerID="30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a"
Jul 29 19:43:56.187512 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.187489    2576 scope.go:117] "RemoveContainer" containerID="30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a"
Jul 29 19:43:56.187822 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:43:56.187803    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a\": container with ID starting with 30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a not found: ID does not exist" containerID="30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a"
Jul 29 19:43:56.187874 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.187832    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a"} err="failed to get container status \"30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a\": rpc error: code = NotFound desc = could not find container \"30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a\": container with ID starting with 30057cc4f20ebdfb912bb726375331ad775f8d4feb56a287c24820d705169e1a not found: ID does not exist"
Jul 29 19:43:56.199620 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.199587    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"]
Jul 29 19:43:56.204176 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.204151    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01750ee0-f94c758b9-7hlk4"]
Jul 29 19:43:56.462460 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.462422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.562673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.562636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.651803 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.651770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.715641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:56.715534    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f693be7-7e15-4399-b6a7-313b80ef5d57" path="/var/lib/kubelet/pods/9f693be7-7e15-4399-b6a7-313b80ef5d57/volumes"
Jul 29 19:43:58.045316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:58.045279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:58.522853 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:58.522808    2576 patch_prober.go:28] interesting pod/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 19:43:58.523027 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:43:58.522870    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:44:00.987179 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:00.987150    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:44:01.053131 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-certs\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053131 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-envoy\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053162    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8ee9171-0628-4d79-9284-3aea69910756-istiod-ca-cert\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv6ls\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-kube-api-access-sv6ls\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053252    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-istio-token\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-data\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053324    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8ee9171-0628-4d79-9284-3aea69910756-istio-podinfo\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053374 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-credential-socket\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053730 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053426    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:44:01.053730 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-socket\") pod \"c8ee9171-0628-4d79-9284-3aea69910756\" (UID: \"c8ee9171-0628-4d79-9284-3aea69910756\") "
Jul 29 19:44:01.053730 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053659    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ee9171-0628-4d79-9284-3aea69910756-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:44:01.053892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053743    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8ee9171-0628-4d79-9284-3aea69910756-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.053892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053760    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.053892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.053861    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:44:01.054045 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.054002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:44:01.054276 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.054256    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:44:01.055497 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.055470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8ee9171-0628-4d79-9284-3aea69910756-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:44:01.055667 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.055493    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-kube-api-access-sv6ls" (OuterVolumeSpecName: "kube-api-access-sv6ls") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "kube-api-access-sv6ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:44:01.055782 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.055744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:44:01.055782 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.055765    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8ee9171-0628-4d79-9284-3aea69910756" (UID: "c8ee9171-0628-4d79-9284-3aea69910756"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:44:01.154942 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.154909    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.154942 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.154938    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv6ls\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-kube-api-access-sv6ls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.154942 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.154949    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8ee9171-0628-4d79-9284-3aea69910756-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.155187 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.154958    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.155187 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.154966    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8ee9171-0628-4d79-9284-3aea69910756-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.155187 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.154974    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.155187 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.154982    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8ee9171-0628-4d79-9284-3aea69910756-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:44:01.206094 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.206058    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8ee9171-0628-4d79-9284-3aea69910756" containerID="2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf" exitCode=0
Jul 29 19:44:01.206293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.206114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" event={"ID":"c8ee9171-0628-4d79-9284-3aea69910756","Type":"ContainerDied","Data":"2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf"}
Jul 29 19:44:01.206293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.206123    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"
Jul 29 19:44:01.206293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.206156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7" event={"ID":"c8ee9171-0628-4d79-9284-3aea69910756","Type":"ContainerDied","Data":"9c04c53b8059610ee60e9d0c13a9665b2d70cdd075c1e2234971b81d6f0c872f"}
Jul 29 19:44:01.206293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.206177    2576 scope.go:117] "RemoveContainer" containerID="2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf"
Jul 29 19:44:01.216007 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.215983    2576 scope.go:117] "RemoveContainer" containerID="53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab"
Jul 29 19:44:01.224266 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.224244    2576 scope.go:117] "RemoveContainer" containerID="2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf"
Jul 29 19:44:01.224569 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:44:01.224524    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf\": container with ID starting with 2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf not found: ID does not exist" containerID="2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf"
Jul 29 19:44:01.224651 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.224572    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf"} err="failed to get container status \"2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf\": rpc error: code = NotFound desc = could not find container \"2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf\": container with ID starting with 2d3f2343abc991e68612c70abce304b4689b70706646dcf813889be1eb48ffbf not found: ID does not exist"
Jul 29 19:44:01.224651 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.224598    2576 scope.go:117] "RemoveContainer" containerID="53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab"
Jul 29 19:44:01.224853 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:44:01.224834    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab\": container with ID starting with 53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab not found: ID does not exist" containerID="53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab"
Jul 29 19:44:01.224904 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.224860    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab"} err="failed to get container status \"53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab\": rpc error: code = NotFound desc = could not find container \"53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab\": container with ID starting with 53f3a8c7755f53f93a6251650c69532e87dc9bb1a19ddec392f8c0d07aa3f9ab not found: ID does not exist"
Jul 29 19:44:01.228181 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.228154    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"]
Jul 29 19:44:01.234105 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:01.234079    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-01750ee0-openshift-default-58fb5bbddd-ms7f7"]
Jul 29 19:44:02.715438 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:02.715406    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ee9171-0628-4d79-9284-3aea69910756" path="/var/lib/kubelet/pods/c8ee9171-0628-4d79-9284-3aea69910756/volumes"
Jul 29 19:44:04.407510 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:04.407479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:04.514536 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:04.514507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:04.609245 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:04.609208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:04.707918 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:04.707846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:05.258928 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:05.258896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:31.077596 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:31.077537    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:37.667298 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:37.667262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:37.791793 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:37.791751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:37.879260 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:37.879229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:53.807618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:53.807579    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:59.998836 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:44:59.998756    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:00.102777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.102744    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:00.172112 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172075    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d"]
Jul 29 19:45:00.172430 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172416    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy"
Jul 29 19:45:00.172476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172432    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy"
Jul 29 19:45:00.172476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172446    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy"
Jul 29 19:45:00.172476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172452    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy"
Jul 29 19:45:00.172476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172461    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f693be7-7e15-4399-b6a7-313b80ef5d57" containerName="maas-api"
Jul 29 19:45:00.172476 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172467    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f693be7-7e15-4399-b6a7-313b80ef5d57" containerName="maas-api"
Jul 29 19:45:00.172680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172479    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy"
Jul 29 19:45:00.172680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172488    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy"
Jul 29 19:45:00.172680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172566    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy"
Jul 29 19:45:00.172680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172577    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy"
Jul 29 19:45:00.172680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172583    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy"
Jul 29 19:45:00.172680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.172590    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f693be7-7e15-4399-b6a7-313b80ef5d57" containerName="maas-api"
Jul 29 19:45:00.175631 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.175613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d"
Jul 29 19:45:00.178944 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.178918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:45:00.185686 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.185662    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d"]
Jul 29 19:45:00.186052 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.186032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d"
Jul 29 19:45:00.211678 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.211649    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:00.328988 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.328953    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d"]
Jul 29 19:45:00.331305 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:45:00.331280    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5108c1e0_69c0_472a_89aa_37ebe248d130.slice/crio-302904a40d626d47b53bbab333893247f5e45741108c068d8389000603dc7447 WatchSource:0}: Error finding container 302904a40d626d47b53bbab333893247f5e45741108c068d8389000603dc7447: Status 404 returned error can't find the container with id 302904a40d626d47b53bbab333893247f5e45741108c068d8389000603dc7447
Jul 29 19:45:00.497318 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:00.497283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d" event={"ID":"5108c1e0-69c0-472a-89aa-37ebe248d130","Type":"ContainerStarted","Data":"302904a40d626d47b53bbab333893247f5e45741108c068d8389000603dc7447"}
Jul 29 19:45:01.503467 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:01.503441    2576 generic.go:356] "Generic (PLEG): container finished" podID="5108c1e0-69c0-472a-89aa-37ebe248d130" containerID="5a70428c718faa352d1c3afe96e94ea905bb05ba621b6c4051b5edb019f8d6a3" exitCode=0
Jul 29 19:45:01.503865 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:01.503522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d" event={"ID":"5108c1e0-69c0-472a-89aa-37ebe248d130","Type":"ContainerDied","Data":"5a70428c718faa352d1c3afe96e94ea905bb05ba621b6c4051b5edb019f8d6a3"}
Jul 29 19:45:02.636513 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:02.636484    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d"
Jul 29 19:45:03.514671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:03.514639    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d"
Jul 29 19:45:03.514875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:03.514673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-nrb8d" event={"ID":"5108c1e0-69c0-472a-89aa-37ebe248d130","Type":"ContainerDied","Data":"302904a40d626d47b53bbab333893247f5e45741108c068d8389000603dc7447"}
Jul 29 19:45:03.514875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:03.514750    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="302904a40d626d47b53bbab333893247f5e45741108c068d8389000603dc7447"
Jul 29 19:45:10.702938 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:10.702898    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:11.500972 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:11.500937    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:19.372032 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:19.371995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:19.479873 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:19.479835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:19.591734 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:19.591694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:19.691899 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:19.691808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:33.337048 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:33.337014    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:33.437284 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:33.437248    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:35.093944 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:35.093876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:42.159020 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:42.158983    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:42.265356 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:42.265324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:42.837890 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:42.837855    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:49.236688 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.236649    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:49.302599 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.302560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:49.447065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.447036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:49.757968 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.757932    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"]
Jul 29 19:45:49.758292 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.758279    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5108c1e0-69c0-472a-89aa-37ebe248d130" containerName="cleanup"
Jul 29 19:45:49.758337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.758294    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5108c1e0-69c0-472a-89aa-37ebe248d130" containerName="cleanup"
Jul 29 19:45:49.758337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.758312    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy"
Jul 29 19:45:49.758337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.758321    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ee9171-0628-4d79-9284-3aea69910756" containerName="istio-proxy"
Jul 29 19:45:49.758436 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.758375    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5108c1e0-69c0-472a-89aa-37ebe248d130" containerName="cleanup"
Jul 29 19:45:49.758436 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.758384    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff159ce-7875-40c2-a330-6de5c1c565f0" containerName="istio-proxy"
Jul 29 19:45:49.761346 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.761325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.763572 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.763534    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-60d3c925-openshift-default-dockercfg-68lnh\""
Jul 29 19:45:49.772236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.772211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"]
Jul 29 19:45:49.852510 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.852438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:49.911871 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.911836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-certs\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.911878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-podinfo\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.911906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-socket\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.911927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4747\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-kube-api-access-m4747\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.911959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-credential-socket\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.911988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-envoy\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.912013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istiod-ca-cert\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912278 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.912056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-data\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.912278 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.912103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-token\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:49.954284 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:49.954249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:50.012873 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.012789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-socket\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.012873 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.012822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4747\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-kube-api-access-m4747\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.012873 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.012841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-credential-socket\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.012873 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.012861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-envoy\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013176 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.012882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istiod-ca-cert\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013176 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.012925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-data\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013176 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.012978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-token\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013176 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.013039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-certs\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.013223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-credential-socket\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.013272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-podinfo\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013390 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.013321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-certs\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013528 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.013425    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-data\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013528 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.013448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-socket\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.013625 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.013610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istiod-ca-cert\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.015180 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.015157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-envoy\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.015691 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.015670    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-podinfo\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.021267 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.021240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-token\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.021457 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.021431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4747\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-kube-api-access-m4747\") pod \"e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") " pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.073032 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.072979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:50.215751 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.215649    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"]
Jul 29 19:45:50.218484 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:45:50.218455    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25831f4_4e4c_4e95_b6b4_d98ca2700e3b.slice/crio-5542fd444c7a9b9b9079ac65636afefd183309e0c8f77fcdf37f4e3e9e1a4972 WatchSource:0}: Error finding container 5542fd444c7a9b9b9079ac65636afefd183309e0c8f77fcdf37f4e3e9e1a4972: Status 404 returned error can't find the container with id 5542fd444c7a9b9b9079ac65636afefd183309e0c8f77fcdf37f4e3e9e1a4972
Jul 29 19:45:50.220530 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.220498    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:45:50.220645 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.220580    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:45:50.220645 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.220610    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:45:50.746753 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.746653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" event={"ID":"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b","Type":"ContainerStarted","Data":"03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d"}
Jul 29 19:45:50.746753 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.746718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" event={"ID":"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b","Type":"ContainerStarted","Data":"5542fd444c7a9b9b9079ac65636afefd183309e0c8f77fcdf37f4e3e9e1a4972"}
Jul 29 19:45:50.768302 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:50.768244    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podStartSLOduration=1.76822889 podStartE2EDuration="1.76822889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:45:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:45:50.765102959 +0000 UTC m=+1844.660920224" watchObservedRunningTime="2026-07-29 19:45:50.76822889 +0000 UTC m=+1844.664046159"
Jul 29 19:45:51.073772 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:51.073731    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:51.078721 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:51.078693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:51.752202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:51.752165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:51.753124 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:51.753103    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:45:52.687121 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.687074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:52.865169 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.865133    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"]
Jul 29 19:45:52.868705 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.868680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:52.872160 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.872135    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-60d3c925-serving-cert\""
Jul 29 19:45:52.898667 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.898524    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"]
Jul 29 19:45:52.909978 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.909946    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:52.940225 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.940134    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54ca100d-7e3e-4689-b882-0448301499d0-maas-api-tls\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:52.940225 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.940171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltm4k\" (UniqueName: \"kubernetes.io/projected/54ca100d-7e3e-4689-b882-0448301499d0-kube-api-access-ltm4k\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:52.940410 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:52.940286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ca100d-7e3e-4689-b882-0448301499d0-openshift-service-ca\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.041326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.041282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ca100d-7e3e-4689-b882-0448301499d0-openshift-service-ca\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.041326 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.041333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54ca100d-7e3e-4689-b882-0448301499d0-maas-api-tls\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.041603 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.041357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltm4k\" (UniqueName: \"kubernetes.io/projected/54ca100d-7e3e-4689-b882-0448301499d0-kube-api-access-ltm4k\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.042041 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.042013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ca100d-7e3e-4689-b882-0448301499d0-openshift-service-ca\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.043875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.043849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54ca100d-7e3e-4689-b882-0448301499d0-maas-api-tls\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.071247 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.071212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltm4k\" (UniqueName: \"kubernetes.io/projected/54ca100d-7e3e-4689-b882-0448301499d0-kube-api-access-ltm4k\") pod \"maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.179357 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.179316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:53.214982 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.214882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:53.340728 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.340699    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"]
Jul 29 19:45:53.343189 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:45:53.343161    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ca100d_7e3e_4689_b882_0448301499d0.slice/crio-f68f8313896ca351356ca0f794d2574aa3d43195b36c0d6819f1ecdb00d9f1b6 WatchSource:0}: Error finding container f68f8313896ca351356ca0f794d2574aa3d43195b36c0d6819f1ecdb00d9f1b6: Status 404 returned error can't find the container with id f68f8313896ca351356ca0f794d2574aa3d43195b36c0d6819f1ecdb00d9f1b6
Jul 29 19:45:53.350836 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.350809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:53.761316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.761281    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:53.763935 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.763901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct" event={"ID":"54ca100d-7e3e-4689-b882-0448301499d0","Type":"ContainerStarted","Data":"f68f8313896ca351356ca0f794d2574aa3d43195b36c0d6819f1ecdb00d9f1b6"}
Jul 29 19:45:53.858168 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:53.858134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:54.771018 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:54.770979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct" event={"ID":"54ca100d-7e3e-4689-b882-0448301499d0","Type":"ContainerStarted","Data":"bfa69a30695205c5ad7a118238bc123409e2348024fc9eea85acc1bf61c518b5"}
Jul 29 19:45:54.771442 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:54.771107    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:45:54.801801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:45:54.801742    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct" podStartSLOduration=2.01312882 podStartE2EDuration="2.801724372s" totalImagesPullingTime="788.595552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:45:54.799147007 +0000 UTC m=+1848.694964278" watchObservedRunningTime="2026-07-29 19:45:54.801724372 +0000 UTC m=+1848.697541640"
Jul 29 19:46:00.781945 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:00.781907    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:46:06.770089 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.769571    2576 patch_prober.go:28] interesting pod/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:41294->10.133.0.56:15021: read: connection reset by peer" start-of-body=
Jul 29 19:46:06.770089 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.769647    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:41294->10.133.0.56:15021: read: connection reset by peer"
Jul 29 19:46:06.836768 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.836734    2576 generic.go:356] "Generic (PLEG): container finished" podID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerID="03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d" exitCode=0
Jul 29 19:46:06.836987 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.836810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" event={"ID":"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b","Type":"ContainerDied","Data":"03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d"}
Jul 29 19:46:06.837255 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.837239    2576 scope.go:117] "RemoveContainer" containerID="03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d"
Jul 29 19:46:06.838287 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.838263    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:46:06.838345 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.838328    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:46:06.838382 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:06.838359    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:46:07.843785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:07.843748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" event={"ID":"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b","Type":"ContainerStarted","Data":"01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733"}
Jul 29 19:46:08.073378 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:08.073344    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:46:08.073596 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:08.073569    2576 patch_prober.go:28] interesting pod/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 19:46:08.073655 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:08.073630    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 19:46:09.073341 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:09.073304    2576 patch_prober.go:28] interesting pod/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 19:46:09.073786 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:09.073358    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 19:46:10.073953 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:10.073913    2576 patch_prober.go:28] interesting pod/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 19:46:10.074352 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:10.073980    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 19:46:11.073890 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:11.073850    2576 patch_prober.go:28] interesting pod/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 19:46:11.074075 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:11.073909    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 19:46:12.074255 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:12.074217    2576 patch_prober.go:28] interesting pod/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 29 19:46:12.074680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:12.074270    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 29 19:46:13.077249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:13.077214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:46:13.077745 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:13.077485    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:46:13.078269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:13.078253    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:46:17.684009 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:17.683971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:18.333127 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:18.333093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:18.425453 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:18.425417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:18.763418 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:18.763371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:24.861468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:24.861437    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:24.926033 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:24.925999    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:28.423687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:28.423602    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:35.761350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:35.761317    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"]
Jul 29 19:46:35.761999 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:35.761584    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct" podUID="54ca100d-7e3e-4689-b882-0448301499d0" containerName="maas-api" containerID="cri-o://bfa69a30695205c5ad7a118238bc123409e2348024fc9eea85acc1bf61c518b5" gracePeriod=30
Jul 29 19:46:35.777836 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:35.777792    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct" podUID="54ca100d-7e3e-4689-b882-0448301499d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.57:8443/health\": dial tcp 10.133.0.57:8443: connect: connection refused"
Jul 29 19:46:35.798643 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:35.798605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:35.896436 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:35.896402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:35.993245 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:35.993207    2576 generic.go:356] "Generic (PLEG): container finished" podID="54ca100d-7e3e-4689-b882-0448301499d0" containerID="bfa69a30695205c5ad7a118238bc123409e2348024fc9eea85acc1bf61c518b5" exitCode=0
Jul 29 19:46:35.993412 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:35.993280    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct" event={"ID":"54ca100d-7e3e-4689-b882-0448301499d0","Type":"ContainerDied","Data":"bfa69a30695205c5ad7a118238bc123409e2348024fc9eea85acc1bf61c518b5"}
Jul 29 19:46:36.005938 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.005903    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:36.022057 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.021994    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:46:36.125835 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.125800    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltm4k\" (UniqueName: \"kubernetes.io/projected/54ca100d-7e3e-4689-b882-0448301499d0-kube-api-access-ltm4k\") pod \"54ca100d-7e3e-4689-b882-0448301499d0\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") "
Jul 29 19:46:36.126003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.125900    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54ca100d-7e3e-4689-b882-0448301499d0-maas-api-tls\") pod \"54ca100d-7e3e-4689-b882-0448301499d0\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") "
Jul 29 19:46:36.126003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.125952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ca100d-7e3e-4689-b882-0448301499d0-openshift-service-ca\") pod \"54ca100d-7e3e-4689-b882-0448301499d0\" (UID: \"54ca100d-7e3e-4689-b882-0448301499d0\") "
Jul 29 19:46:36.126310 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.126280    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ca100d-7e3e-4689-b882-0448301499d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54ca100d-7e3e-4689-b882-0448301499d0" (UID: "54ca100d-7e3e-4689-b882-0448301499d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:46:36.128092 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.128056    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ca100d-7e3e-4689-b882-0448301499d0-kube-api-access-ltm4k" (OuterVolumeSpecName: "kube-api-access-ltm4k") pod "54ca100d-7e3e-4689-b882-0448301499d0" (UID: "54ca100d-7e3e-4689-b882-0448301499d0"). InnerVolumeSpecName "kube-api-access-ltm4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:46:36.128239 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.128094    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ca100d-7e3e-4689-b882-0448301499d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54ca100d-7e3e-4689-b882-0448301499d0" (UID: "54ca100d-7e3e-4689-b882-0448301499d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:46:36.138046 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.138018    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:36.226615 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.226574    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54ca100d-7e3e-4689-b882-0448301499d0-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:36.226615 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.226609    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ca100d-7e3e-4689-b882-0448301499d0-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:36.226615 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.226619    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltm4k\" (UniqueName: \"kubernetes.io/projected/54ca100d-7e3e-4689-b882-0448301499d0-kube-api-access-ltm4k\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:36.571409 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.571371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:36.999359 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.999274    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"
Jul 29 19:46:36.999359 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.999320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct" event={"ID":"54ca100d-7e3e-4689-b882-0448301499d0","Type":"ContainerDied","Data":"f68f8313896ca351356ca0f794d2574aa3d43195b36c0d6819f1ecdb00d9f1b6"}
Jul 29 19:46:36.999871 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:36.999376    2576 scope.go:117] "RemoveContainer" containerID="bfa69a30695205c5ad7a118238bc123409e2348024fc9eea85acc1bf61c518b5"
Jul 29 19:46:37.016994 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:37.016961    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"]
Jul 29 19:46:37.020998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:37.020969    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-60d3c925-6577dfcc6d-7bwct"]
Jul 29 19:46:38.715376 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:38.715338    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ca100d-7e3e-4689-b882-0448301499d0" path="/var/lib/kubelet/pods/54ca100d-7e3e-4689-b882-0448301499d0/volumes"
Jul 29 19:46:42.806957 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:42.806877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:42.910098 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:42.910069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:43.077244 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:43.077147    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"]
Jul 29 19:46:43.077416 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:43.077385    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy" containerID="cri-o://01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733" gracePeriod=30
Jul 29 19:46:43.104174 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:43.104142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:43.338294 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:43.338203    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:43.488432 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:43.488391    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:43.583259 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:43.583222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:43.688707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:43.688628    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:48.326862 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.326830    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:46:48.436145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436055    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-socket\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436093    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-credential-socket\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istiod-ca-cert\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436141    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-token\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-envoy\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436225    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-certs\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436270    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4747\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-kube-api-access-m4747\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436342    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-podinfo\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436379    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-data\") pod \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\" (UID: \"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b\") "
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436393    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436431    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436618    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436678    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:46:48.436696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.436700    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.437458 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.437432    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:46:48.438609 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.438573    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:46:48.438609 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.438584    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-kube-api-access-m4747" (OuterVolumeSpecName: "kube-api-access-m4747") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "kube-api-access-m4747". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:46:48.438851 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.438820    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:46:48.438851 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.438829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" (UID: "a25831f4-4e4c-4e95-b6b4-d98ca2700e3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:46:48.537290 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.537240    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4747\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-kube-api-access-m4747\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.537290 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.537285    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.537290 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.537295    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.537290 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.537304    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.537290 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.537311    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.537645 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.537319    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:48.537645 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:48.537327    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:46:49.063472 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.063438    2576 generic.go:356] "Generic (PLEG): container finished" podID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerID="01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733" exitCode=0
Jul 29 19:46:49.063666 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.063486    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"
Jul 29 19:46:49.063666 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.063516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" event={"ID":"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b","Type":"ContainerDied","Data":"01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733"}
Jul 29 19:46:49.063666 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.063585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t" event={"ID":"a25831f4-4e4c-4e95-b6b4-d98ca2700e3b","Type":"ContainerDied","Data":"5542fd444c7a9b9b9079ac65636afefd183309e0c8f77fcdf37f4e3e9e1a4972"}
Jul 29 19:46:49.063666 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.063609    2576 scope.go:117] "RemoveContainer" containerID="01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733"
Jul 29 19:46:49.072234 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.072217    2576 scope.go:117] "RemoveContainer" containerID="03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d"
Jul 29 19:46:49.080151 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.080129    2576 scope.go:117] "RemoveContainer" containerID="01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733"
Jul 29 19:46:49.080405 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:46:49.080384    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733\": container with ID starting with 01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733 not found: ID does not exist" containerID="01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733"
Jul 29 19:46:49.080468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.080415    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733"} err="failed to get container status \"01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733\": rpc error: code = NotFound desc = could not find container \"01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733\": container with ID starting with 01b4da25975be0e6297ec4728865c96a43bc9ff4ef7036193fc9c8a0790bb733 not found: ID does not exist"
Jul 29 19:46:49.080468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.080432    2576 scope.go:117] "RemoveContainer" containerID="03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d"
Jul 29 19:46:49.080697 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:46:49.080678    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d\": container with ID starting with 03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d not found: ID does not exist" containerID="03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d"
Jul 29 19:46:49.080750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.080703    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d"} err="failed to get container status \"03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d\": rpc error: code = NotFound desc = could not find container \"03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d\": container with ID starting with 03f2333a1315318c3550ed0c455d6248458486c59d8c154320fc01e77b29457d not found: ID does not exist"
Jul 29 19:46:49.080851 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.080835    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"]
Jul 29 19:46:49.085155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.085134    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-60d3c925-openshift-default-595f945b68-hjp2t"]
Jul 29 19:46:49.605690 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.605658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:49.709773 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.709741    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:49.805654 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.805614    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:49.954773 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:49.954681    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:50.714776 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:50.714734    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" path="/var/lib/kubelet/pods/a25831f4-4e4c-4e95-b6b4-d98ca2700e3b/volumes"
Jul 29 19:46:56.085329 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:56.085296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:56.187278 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:46:56.187238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:03.003240 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.003196    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:03.266264 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.266181    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"]
Jul 29 19:47:03.266566 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.266538    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy"
Jul 29 19:47:03.266621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.266566    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy"
Jul 29 19:47:03.266621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.266585    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ca100d-7e3e-4689-b882-0448301499d0" containerName="maas-api"
Jul 29 19:47:03.266621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.266591    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ca100d-7e3e-4689-b882-0448301499d0" containerName="maas-api"
Jul 29 19:47:03.266730 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.266645    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ca100d-7e3e-4689-b882-0448301499d0" containerName="maas-api"
Jul 29 19:47:03.266730 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.266653    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy"
Jul 29 19:47:03.271418 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.271394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.274123 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.274100    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b20ef80a-openshift-default-dockercfg-v5wk6\""
Jul 29 19:47:03.284772 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.284741    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"]
Jul 29 19:47:03.308760 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.308725    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:03.377783 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.377747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-token\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.377981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.377796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-socket\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.377981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.377875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-podinfo\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.377981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.377937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-certs\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.377981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.377962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-data\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.378155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.377991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-credential-socket\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.378155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.378068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istiod-ca-cert\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.378155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.378108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w85s9\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-kube-api-access-w85s9\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.378155 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.378137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-envoy\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.448514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.448476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:03.479124 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-token\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-socket\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-podinfo\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-certs\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-data\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479331 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-credential-socket\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istiod-ca-cert\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w85s9\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-kube-api-access-w85s9\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-envoy\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479814 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-certs\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-data\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-socket\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.479985 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.479911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-credential-socket\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.480219 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.480200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istiod-ca-cert\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.481678 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.481659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-envoy\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.481814 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.481795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-podinfo\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.488302 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.488273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-token\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.488690 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.488664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w85s9\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-kube-api-access-w85s9\") pod \"e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") " pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.582453 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.582354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:03.725590 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.725561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"]
Jul 29 19:47:03.727533 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:47:03.727501    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83bdcd4_7a09_4559_8c01_4f5ea1c0628e.slice/crio-4acde6e375e3c41320475eec83cd07f59b71da2a48ceabcab535443a41890ff9 WatchSource:0}: Error finding container 4acde6e375e3c41320475eec83cd07f59b71da2a48ceabcab535443a41890ff9: Status 404 returned error can't find the container with id 4acde6e375e3c41320475eec83cd07f59b71da2a48ceabcab535443a41890ff9
Jul 29 19:47:03.729697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.729662    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:47:03.729805 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.729733    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:47:03.729805 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:03.729763    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:47:04.138444 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:04.138410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" event={"ID":"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e","Type":"ContainerStarted","Data":"1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c"}
Jul 29 19:47:04.138875 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:04.138463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" event={"ID":"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e","Type":"ContainerStarted","Data":"4acde6e375e3c41320475eec83cd07f59b71da2a48ceabcab535443a41890ff9"}
Jul 29 19:47:04.161051 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:04.160984    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" podStartSLOduration=1.1609654 podStartE2EDuration="1.1609654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:47:04.158442682 +0000 UTC m=+1918.054259955" watchObservedRunningTime="2026-07-29 19:47:04.1609654 +0000 UTC m=+1918.056782665"
Jul 29 19:47:04.583158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:04.583114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:04.588104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:04.588076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:05.143161 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:05.143129    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:05.144245 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:05.144221    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:06.057725 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.057689    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:06.156195 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.156156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:06.158989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.158959    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"]
Jul 29 19:47:06.159493 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.159476    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy"
Jul 29 19:47:06.159539 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.159497    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy"
Jul 29 19:47:06.159734 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.159717    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a25831f4-4e4c-4e95-b6b4-d98ca2700e3b" containerName="istio-proxy"
Jul 29 19:47:06.165579 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.165537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.168079 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.168055    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b20ef80a-serving-cert\""
Jul 29 19:47:06.169687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.169662    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"]
Jul 29 19:47:06.238627 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.238574    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:06.304071 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.304030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sctr\" (UniqueName: \"kubernetes.io/projected/23dc5afd-5129-47b3-a5c4-946f4bd10561-kube-api-access-2sctr\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.304254 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.304088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.304303 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.304248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dc5afd-5129-47b3-a5c4-946f4bd10561-openshift-service-ca\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.405821 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.405710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dc5afd-5129-47b3-a5c4-946f4bd10561-openshift-service-ca\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.405821 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.405802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sctr\" (UniqueName: \"kubernetes.io/projected/23dc5afd-5129-47b3-a5c4-946f4bd10561-kube-api-access-2sctr\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.406065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.405833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.406065 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:47:06.405960    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-serving-cert: secret "maas-api-e2e-mt-b20ef80a-serving-cert" not found
Jul 29 19:47:06.406065 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:47:06.406038    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls podName:23dc5afd-5129-47b3-a5c4-946f4bd10561 nodeName:}" failed. No retries permitted until 2026-07-29 19:47:06.906014422 +0000 UTC m=+1920.801831671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls") pod "maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s" (UID: "23dc5afd-5129-47b3-a5c4-946f4bd10561") : secret "maas-api-e2e-mt-b20ef80a-serving-cert" not found
Jul 29 19:47:06.406417 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.406396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dc5afd-5129-47b3-a5c4-946f4bd10561-openshift-service-ca\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.424403 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.424364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sctr\" (UniqueName: \"kubernetes.io/projected/23dc5afd-5129-47b3-a5c4-946f4bd10561-kube-api-access-2sctr\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.670970 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.670882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:06.883532 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.883496    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:06.909826 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.909789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.912277 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.912256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls\") pod \"maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:06.978219 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:06.978107    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:07.077636 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:07.077594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:07.237441 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:07.237412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"]
Jul 29 19:47:07.239433 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:47:07.239403    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23dc5afd_5129_47b3_a5c4_946f4bd10561.slice/crio-1ef899ba1aa24805ddff8f7a8eb3afc249230e59d4d72f75028b7d8f6fb7bd3f WatchSource:0}: Error finding container 1ef899ba1aa24805ddff8f7a8eb3afc249230e59d4d72f75028b7d8f6fb7bd3f: Status 404 returned error can't find the container with id 1ef899ba1aa24805ddff8f7a8eb3afc249230e59d4d72f75028b7d8f6fb7bd3f
Jul 29 19:47:07.241334 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:07.241314    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:47:08.161560 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:08.161513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s" event={"ID":"23dc5afd-5129-47b3-a5c4-946f4bd10561","Type":"ContainerStarted","Data":"4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324"}
Jul 29 19:47:08.161769 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:08.161680    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:08.161769 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:08.161710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s" event={"ID":"23dc5afd-5129-47b3-a5c4-946f4bd10561","Type":"ContainerStarted","Data":"1ef899ba1aa24805ddff8f7a8eb3afc249230e59d4d72f75028b7d8f6fb7bd3f"}
Jul 29 19:47:08.180327 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:08.180272    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s" podStartSLOduration=1.717733502 podStartE2EDuration="2.180258195s" totalImagesPullingTime="462.524693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:47:08.178257265 +0000 UTC m=+1922.074074534" watchObservedRunningTime="2026-07-29 19:47:08.180258195 +0000 UTC m=+1922.076075464"
Jul 29 19:47:14.172705 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:14.172673    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:47:19.218317 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:19.218215    2576 generic.go:356] "Generic (PLEG): container finished" podID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerID="1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c" exitCode=0
Jul 29 19:47:19.218317 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:19.218283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" event={"ID":"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e","Type":"ContainerDied","Data":"1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c"}
Jul 29 19:47:19.218785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:19.218682    2576 scope.go:117] "RemoveContainer" containerID="1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c"
Jul 29 19:47:19.219654 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:19.219628    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:47:19.219722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:19.219695    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:47:19.219759 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:19.219726    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:47:20.143462 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:20.143393    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:20.225387 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:20.225349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" event={"ID":"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e","Type":"ContainerStarted","Data":"1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627"}
Jul 29 19:47:20.583456 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:20.583415    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:20.584750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:20.584716    2576 patch_prober.go:28] interesting pod/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 19:47:20.584925 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:20.584773    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 19:47:21.583831 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:21.583788    2576 patch_prober.go:28] interesting pod/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 19:47:21.584248 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:21.583859    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 19:47:22.285680 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:22.285643    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:22.583126 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:22.583035    2576 patch_prober.go:28] interesting pod/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 19:47:22.583126 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:22.583091    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 19:47:23.583127 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:23.583085    2576 patch_prober.go:28] interesting pod/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 29 19:47:23.583584 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:23.583151    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 29 19:47:24.587634 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:24.587593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:24.588056 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:24.587855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:24.588439 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:24.588421    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:47:24.985468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:24.985373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:25.085727 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:25.085693    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:31.058203 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:31.058169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:34.752647 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:34.752529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:55.033538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.030829    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"]
Jul 29 19:47:55.038116 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.038081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"
Jul 29 19:47:55.040896 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.040713    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:47:55.042130 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.042098    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"]
Jul 29 19:47:55.127112 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.127074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d16f50-857d-428f-9725-6a339408896f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk\" (UID: \"59d16f50-857d-428f-9725-6a339408896f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"
Jul 29 19:47:55.228118 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.228076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d16f50-857d-428f-9725-6a339408896f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk\" (UID: \"59d16f50-857d-428f-9725-6a339408896f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"
Jul 29 19:47:55.228799 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.228779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d16f50-857d-428f-9725-6a339408896f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk\" (UID: \"59d16f50-857d-428f-9725-6a339408896f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"
Jul 29 19:47:55.351503 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.351407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"
Jul 29 19:47:55.496758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:55.496726    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"]
Jul 29 19:47:55.499046 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:47:55.499016    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d16f50_857d_428f_9725_6a339408896f.slice/crio-0b3daea53fafb1f262f90a9c8b0a56e552f086037d0dd65fb1af3d3f8af01351 WatchSource:0}: Error finding container 0b3daea53fafb1f262f90a9c8b0a56e552f086037d0dd65fb1af3d3f8af01351: Status 404 returned error can't find the container with id 0b3daea53fafb1f262f90a9c8b0a56e552f086037d0dd65fb1af3d3f8af01351
Jul 29 19:47:56.422041 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:56.422004    2576 generic.go:356] "Generic (PLEG): container finished" podID="59d16f50-857d-428f-9725-6a339408896f" containerID="11798fe2dbaea99b03e37e447cad2a8d607db3c8f977dad4c37a0e7e2e495482" exitCode=0
Jul 29 19:47:56.422431 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:56.422060    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk" event={"ID":"59d16f50-857d-428f-9725-6a339408896f","Type":"ContainerDied","Data":"11798fe2dbaea99b03e37e447cad2a8d607db3c8f977dad4c37a0e7e2e495482"}
Jul 29 19:47:56.422431 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:56.422112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk" event={"ID":"59d16f50-857d-428f-9725-6a339408896f","Type":"ContainerStarted","Data":"0b3daea53fafb1f262f90a9c8b0a56e552f086037d0dd65fb1af3d3f8af01351"}
Jul 29 19:47:57.563241 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:57.563217    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"
Jul 29 19:47:57.649898 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:57.649858    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d16f50-857d-428f-9725-6a339408896f-maas-api-service-ca\") pod \"59d16f50-857d-428f-9725-6a339408896f\" (UID: \"59d16f50-857d-428f-9725-6a339408896f\") "
Jul 29 19:47:57.650262 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:57.650239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59d16f50-857d-428f-9725-6a339408896f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59d16f50-857d-428f-9725-6a339408896f" (UID: "59d16f50-857d-428f-9725-6a339408896f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:47:57.751215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:57.751123    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d16f50-857d-428f-9725-6a339408896f-maas-api-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:47:58.433957 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:58.433918    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"
Jul 29 19:47:58.434156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:58.433917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk" event={"ID":"59d16f50-857d-428f-9725-6a339408896f","Type":"ContainerDied","Data":"0b3daea53fafb1f262f90a9c8b0a56e552f086037d0dd65fb1af3d3f8af01351"}
Jul 29 19:47:58.434156 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:47:58.434081    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b3daea53fafb1f262f90a9c8b0a56e552f086037d0dd65fb1af3d3f8af01351"
Jul 29 19:48:10.531776 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.531717    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"]
Jul 29 19:48:10.532313 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.532053    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s" podUID="23dc5afd-5129-47b3-a5c4-946f4bd10561" containerName="maas-api" containerID="cri-o://4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324" gracePeriod=30
Jul 29 19:48:10.557318 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.557285    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:10.658310 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.658237    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:10.744535 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.744500    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"]
Jul 29 19:48:10.749103 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.749070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:10.749372 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.749353    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b20ef80a-94zbk"]
Jul 29 19:48:10.796695 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.796623    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:48:10.808215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.808185    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:10.875513 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.875475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sctr\" (UniqueName: \"kubernetes.io/projected/23dc5afd-5129-47b3-a5c4-946f4bd10561-kube-api-access-2sctr\") pod \"23dc5afd-5129-47b3-a5c4-946f4bd10561\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") "
Jul 29 19:48:10.877762 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.877733    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23dc5afd-5129-47b3-a5c4-946f4bd10561-kube-api-access-2sctr" (OuterVolumeSpecName: "kube-api-access-2sctr") pod "23dc5afd-5129-47b3-a5c4-946f4bd10561" (UID: "23dc5afd-5129-47b3-a5c4-946f4bd10561"). InnerVolumeSpecName "kube-api-access-2sctr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:48:10.977074 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.977030    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls\") pod \"23dc5afd-5129-47b3-a5c4-946f4bd10561\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") "
Jul 29 19:48:10.977074 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.977082    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dc5afd-5129-47b3-a5c4-946f4bd10561-openshift-service-ca\") pod \"23dc5afd-5129-47b3-a5c4-946f4bd10561\" (UID: \"23dc5afd-5129-47b3-a5c4-946f4bd10561\") "
Jul 29 19:48:10.977339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.977301    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sctr\" (UniqueName: \"kubernetes.io/projected/23dc5afd-5129-47b3-a5c4-946f4bd10561-kube-api-access-2sctr\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:48:10.977436 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.977411    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23dc5afd-5129-47b3-a5c4-946f4bd10561-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23dc5afd-5129-47b3-a5c4-946f4bd10561" (UID: "23dc5afd-5129-47b3-a5c4-946f4bd10561"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:48:10.979102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:10.979081    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23dc5afd-5129-47b3-a5c4-946f4bd10561" (UID: "23dc5afd-5129-47b3-a5c4-946f4bd10561"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:48:11.078675 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.078575    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23dc5afd-5129-47b3-a5c4-946f4bd10561-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:48:11.078675 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.078615    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23dc5afd-5129-47b3-a5c4-946f4bd10561-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:48:11.503134 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.503109    2576 generic.go:356] "Generic (PLEG): container finished" podID="23dc5afd-5129-47b3-a5c4-946f4bd10561" containerID="4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324" exitCode=0
Jul 29 19:48:11.503272 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.503171    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"
Jul 29 19:48:11.503272 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.503196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s" event={"ID":"23dc5afd-5129-47b3-a5c4-946f4bd10561","Type":"ContainerDied","Data":"4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324"}
Jul 29 19:48:11.503360 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.503283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s" event={"ID":"23dc5afd-5129-47b3-a5c4-946f4bd10561","Type":"ContainerDied","Data":"1ef899ba1aa24805ddff8f7a8eb3afc249230e59d4d72f75028b7d8f6fb7bd3f"}
Jul 29 19:48:11.503360 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.503313    2576 scope.go:117] "RemoveContainer" containerID="4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324"
Jul 29 19:48:11.513569 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.513529    2576 scope.go:117] "RemoveContainer" containerID="4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324"
Jul 29 19:48:11.513885 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:48:11.513858    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324\": container with ID starting with 4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324 not found: ID does not exist" containerID="4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324"
Jul 29 19:48:11.513949 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.513897    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324"} err="failed to get container status \"4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324\": rpc error: code = NotFound desc = could not find container \"4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324\": container with ID starting with 4aa3fcfad2bbc83d202d42bd54a1319b7a1654a63f454d128745d3b75aa3d324 not found: ID does not exist"
Jul 29 19:48:11.528581 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.528315    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"]
Jul 29 19:48:11.532029 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:11.532005    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b20ef80a-c7b5cd85b-2j92s"]
Jul 29 19:48:12.714750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:12.714715    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23dc5afd-5129-47b3-a5c4-946f4bd10561" path="/var/lib/kubelet/pods/23dc5afd-5129-47b3-a5c4-946f4bd10561/volumes"
Jul 29 19:48:12.715139 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:12.715047    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59d16f50-857d-428f-9725-6a339408896f" path="/var/lib/kubelet/pods/59d16f50-857d-428f-9725-6a339408896f/volumes"
Jul 29 19:48:13.887964 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:13.887929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:18.922196 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:18.922156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:55.467956 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:55.467924    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:56.326828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:48:56.326791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:02.248540 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:02.248505    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:08.079515 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:08.079470    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:08.152556 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:08.152508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:08.405064 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:08.404974    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"]
Jul 29 19:49:08.405323 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:08.405298    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy" containerID="cri-o://1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627" gracePeriod=30
Jul 29 19:49:08.414973 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:08.414945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:08.632192 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:08.632154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:09.590142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:09.590108    2576 patch_prober.go:28] interesting pod/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 19:49:09.590523 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:09.590169    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:49:09.664305 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:09.664253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:09.754215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:09.754185    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:09.854205 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:09.854128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:10.569256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:10.569219    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:10.663774 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:10.663736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:10.765692 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:10.765646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:12.093449 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:12.093410    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:13.658960 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.658935    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:49:13.724201 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724110    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w85s9\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-kube-api-access-w85s9\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724201 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724164    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-token\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724201 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724183    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-data\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724459 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724226    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-socket\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724459 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-certs\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724459 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istiod-ca-cert\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724459 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724384    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-podinfo\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724459 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724419    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-envoy\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724735 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724466    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-credential-socket\") pod \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\" (UID: \"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e\") "
Jul 29 19:49:13.724735 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:49:13.724834 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724778    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.724897 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724831    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:49:13.724897 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724765    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:49:13.725010 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.724976    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:49:13.725199 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.725173    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:49:13.726538 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.726511    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-kube-api-access-w85s9" (OuterVolumeSpecName: "kube-api-access-w85s9") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "kube-api-access-w85s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:49:13.726662 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.726558    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:49:13.726948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.726925    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:49:13.727033 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.726943    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" (UID: "e83bdcd4-7a09-4559-8c01-4f5ea1c0628e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:49:13.825215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825169    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.825215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825195    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.825215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825207    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.825215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825219    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.825215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825228    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.825215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825235    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.825728 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825244    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.825728 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.825253    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w85s9\" (UniqueName: \"kubernetes.io/projected/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e-kube-api-access-w85s9\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:49:13.829030 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.829002    2576 generic.go:356] "Generic (PLEG): container finished" podID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerID="1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627" exitCode=0
Jul 29 19:49:13.829146 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.829056    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"
Jul 29 19:49:13.829146 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.829090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" event={"ID":"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e","Type":"ContainerDied","Data":"1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627"}
Jul 29 19:49:13.829216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.829147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4" event={"ID":"e83bdcd4-7a09-4559-8c01-4f5ea1c0628e","Type":"ContainerDied","Data":"4acde6e375e3c41320475eec83cd07f59b71da2a48ceabcab535443a41890ff9"}
Jul 29 19:49:13.829216 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.829177    2576 scope.go:117] "RemoveContainer" containerID="1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627"
Jul 29 19:49:13.838826 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.838808    2576 scope.go:117] "RemoveContainer" containerID="1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c"
Jul 29 19:49:13.847119 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.847095    2576 scope.go:117] "RemoveContainer" containerID="1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627"
Jul 29 19:49:13.847448 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:49:13.847423    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627\": container with ID starting with 1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627 not found: ID does not exist" containerID="1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627"
Jul 29 19:49:13.847617 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.847458    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627"} err="failed to get container status \"1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627\": rpc error: code = NotFound desc = could not find container \"1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627\": container with ID starting with 1dcf5ed6bcfc4cb20eb2238a3622fece3ccf4e8f1c3dddad7cfc36ad23607627 not found: ID does not exist"
Jul 29 19:49:13.847617 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.847477    2576 scope.go:117] "RemoveContainer" containerID="1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c"
Jul 29 19:49:13.847883 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:49:13.847810    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c\": container with ID starting with 1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c not found: ID does not exist" containerID="1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c"
Jul 29 19:49:13.847883 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.847844    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c"} err="failed to get container status \"1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c\": rpc error: code = NotFound desc = could not find container \"1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c\": container with ID starting with 1df11588c70bdd7a9c82481b63323d3da7f6abf394e7be438f4a84c1b9d0493c not found: ID does not exist"
Jul 29 19:49:13.850909 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.850885    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"]
Jul 29 19:49:13.862479 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:13.862451    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b20ef80a-openshift-default-ddddd4c6d-wqwb4"]
Jul 29 19:49:14.715423 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:14.715390    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" path="/var/lib/kubelet/pods/e83bdcd4-7a09-4559-8c01-4f5ea1c0628e/volumes"
Jul 29 19:49:18.805396 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:18.805358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:18.893829 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:18.893792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:19.460256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:19.460224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:25.929919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:25.929880    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:26.034081 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:26.034046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:26.131186 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:26.131150    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:36.645189 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:36.645146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:36.980540 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:36.980449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:57.995050 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:49:57.995009    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:04.564851 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:04.564817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:04.666042 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:04.666008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:04.923162 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:04.923077    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:05.204932 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.204848    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"]
Jul 29 19:50:05.205192 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205179    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d16f50-857d-428f-9725-6a339408896f" containerName="revoke-keys"
Jul 29 19:50:05.205236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205193    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d16f50-857d-428f-9725-6a339408896f" containerName="revoke-keys"
Jul 29 19:50:05.205236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205210    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23dc5afd-5129-47b3-a5c4-946f4bd10561" containerName="maas-api"
Jul 29 19:50:05.205236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205215    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="23dc5afd-5129-47b3-a5c4-946f4bd10561" containerName="maas-api"
Jul 29 19:50:05.205236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205225    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy"
Jul 29 19:50:05.205236 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205231    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy"
Jul 29 19:50:05.205392 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205284    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy"
Jul 29 19:50:05.205392 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205295    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="23dc5afd-5129-47b3-a5c4-946f4bd10561" containerName="maas-api"
Jul 29 19:50:05.205392 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.205301    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="59d16f50-857d-428f-9725-6a339408896f" containerName="revoke-keys"
Jul 29 19:50:05.208327 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.208309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.210729 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.210706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4d9536-openshift-default-dockercfg-hgc8n\""
Jul 29 19:50:05.225187 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.225157    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"]
Jul 29 19:50:05.229595 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.229570    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:05.267810 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.267773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhtb4\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-kube-api-access-xhtb4\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.267979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.267836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-socket\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.267979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.267855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-token\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.267979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.267892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-certs\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.268097 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.267986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-credential-socket\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.268097 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.268010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-data\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.268097 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.268026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istiod-ca-cert\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.268261 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.268123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-envoy\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.268261 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.268176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-podinfo\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368698 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-socket\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368698 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-token\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-certs\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-credential-socket\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-data\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istiod-ca-cert\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-envoy\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-podinfo\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.368952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.368950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhtb4\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-kube-api-access-xhtb4\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.369333 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.369146    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-socket\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.369333 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.369216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-certs\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.369333 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.369224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-data\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.369505 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.369417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-credential-socket\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.369663 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.369642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istiod-ca-cert\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.371663 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.371633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-envoy\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.371838 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.371813    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-podinfo\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.383458 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.383435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhtb4\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-kube-api-access-xhtb4\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.383848 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.383831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-token\") pod \"e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") " pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.429805 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.429773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:05.519364 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.519324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:05.658042 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.658014    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"]
Jul 29 19:50:05.660157 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:50:05.660131    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac52bee2_f276_4cdd_a5b9_aa5bc39d8ebd.slice/crio-dce837216ad81d28d7ca44348289614575dd830a28c0d10634f4681e6f8efdfb WatchSource:0}: Error finding container dce837216ad81d28d7ca44348289614575dd830a28c0d10634f4681e6f8efdfb: Status 404 returned error can't find the container with id dce837216ad81d28d7ca44348289614575dd830a28c0d10634f4681e6f8efdfb
Jul 29 19:50:05.662213 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.662184    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:05.662281 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.662247    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:05.662281 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:05.662273    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:06.101460 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:06.101416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" event={"ID":"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd","Type":"ContainerStarted","Data":"96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c"}
Jul 29 19:50:06.101653 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:06.101506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" event={"ID":"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd","Type":"ContainerStarted","Data":"dce837216ad81d28d7ca44348289614575dd830a28c0d10634f4681e6f8efdfb"}
Jul 29 19:50:06.124802 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:06.124736    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" podStartSLOduration=1.124716658 podStartE2EDuration="1.124716658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:06.124372277 +0000 UTC m=+2100.020189542" watchObservedRunningTime="2026-07-29 19:50:06.124716658 +0000 UTC m=+2100.020533928"
Jul 29 19:50:06.519497 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:06.519455    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:06.524894 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:06.524864    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:07.106828 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:07.106797    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:07.107847 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:07.107828    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:08.073019 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.072975    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:08.175563 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.175524    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:08.206018 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.205979    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"]
Jul 29 19:50:08.206335 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.206323    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy"
Jul 29 19:50:08.206391 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.206336    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy"
Jul 29 19:50:08.206430 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.206403    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e83bdcd4-7a09-4559-8c01-4f5ea1c0628e" containerName="istio-proxy"
Jul 29 19:50:08.210619 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.210596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.212970 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.212946    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4d9536-serving-cert\""
Jul 29 19:50:08.244976 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.244942    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"]
Jul 29 19:50:08.294862 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.294818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.295035 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.294881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dnd4\" (UniqueName: \"kubernetes.io/projected/74818d7b-9847-4149-b92f-0a84468d5df9-kube-api-access-7dnd4\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.295035 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.294932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74818d7b-9847-4149-b92f-0a84468d5df9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.313997 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.313961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:08.395650 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.395522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.395650 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.395611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dnd4\" (UniqueName: \"kubernetes.io/projected/74818d7b-9847-4149-b92f-0a84468d5df9-kube-api-access-7dnd4\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.395903 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.395655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74818d7b-9847-4149-b92f-0a84468d5df9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.395903 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:50:08.395678    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-serving-cert: secret "maas-api-e2e-inf-a-4d9536-serving-cert" not found
Jul 29 19:50:08.395903 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:50:08.395742    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls podName:74818d7b-9847-4149-b92f-0a84468d5df9 nodeName:}" failed. No retries permitted until 2026-07-29 19:50:08.89572449 +0000 UTC m=+2102.791541738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls") pod "maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" (UID: "74818d7b-9847-4149-b92f-0a84468d5df9") : secret "maas-api-e2e-inf-a-4d9536-serving-cert" not found
Jul 29 19:50:08.396375 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.396353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74818d7b-9847-4149-b92f-0a84468d5df9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.410468 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.410439    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dnd4\" (UniqueName: \"kubernetes.io/projected/74818d7b-9847-4149-b92f-0a84468d5df9-kube-api-access-7dnd4\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.900882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.900837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:08.901076 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:50:08.901002    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-serving-cert: secret "maas-api-e2e-inf-a-4d9536-serving-cert" not found
Jul 29 19:50:08.901149 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:50:08.901091    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls podName:74818d7b-9847-4149-b92f-0a84468d5df9 nodeName:}" failed. No retries permitted until 2026-07-29 19:50:09.901071032 +0000 UTC m=+2103.796888285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls") pod "maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" (UID: "74818d7b-9847-4149-b92f-0a84468d5df9") : secret "maas-api-e2e-inf-a-4d9536-serving-cert" not found
Jul 29 19:50:08.949073 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:08.949041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:09.046181 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:09.046150    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:09.131061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:09.131023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:09.911654 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:09.911611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:09.914076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:09.914051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls\") pod \"maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:10.020775 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:10.020738    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:10.157932 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:10.157744    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"]
Jul 29 19:50:10.160458 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:50:10.160420    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74818d7b_9847_4149_b92f_0a84468d5df9.slice/crio-e9b0d5cb23a43131ced54c4a79718b9f70953af2d8c0682a4b7281b4fc366a2b WatchSource:0}: Error finding container e9b0d5cb23a43131ced54c4a79718b9f70953af2d8c0682a4b7281b4fc366a2b: Status 404 returned error can't find the container with id e9b0d5cb23a43131ced54c4a79718b9f70953af2d8c0682a4b7281b4fc366a2b
Jul 29 19:50:11.128660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:11.128625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" event={"ID":"74818d7b-9847-4149-b92f-0a84468d5df9","Type":"ContainerStarted","Data":"9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2"}
Jul 29 19:50:11.129065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:11.128675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" event={"ID":"74818d7b-9847-4149-b92f-0a84468d5df9","Type":"ContainerStarted","Data":"e9b0d5cb23a43131ced54c4a79718b9f70953af2d8c0682a4b7281b4fc366a2b"}
Jul 29 19:50:11.129065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:11.128707    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:11.146516 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:11.146469    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" podStartSLOduration=2.569604936 podStartE2EDuration="3.14645238s" totalImagesPullingTime="576.847444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:11.144619249 +0000 UTC m=+2105.040436597" watchObservedRunningTime="2026-07-29 19:50:11.14645238 +0000 UTC m=+2105.042269649"
Jul 29 19:50:14.749255 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:14.749217    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:17.147115 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:17.147063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:50:22.108364 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.108318    2576 patch_prober.go:28] interesting pod/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 29 19:50:22.108844 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.108393    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 29 19:50:22.194978 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.194890    2576 generic.go:356] "Generic (PLEG): container finished" podID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerID="96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c" exitCode=0
Jul 29 19:50:22.194978 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.194965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" event={"ID":"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd","Type":"ContainerDied","Data":"96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c"}
Jul 29 19:50:22.195405 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.195391    2576 scope.go:117] "RemoveContainer" containerID="96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c"
Jul 29 19:50:22.196402 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.196376    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:22.196477 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.196444    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:22.196515 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:22.196478    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:23.204259 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:23.204223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" event={"ID":"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd","Type":"ContainerStarted","Data":"a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d"}
Jul 29 19:50:23.519681 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:23.519646    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:23.520006 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:23.519980    2576 patch_prober.go:28] interesting pod/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 29 19:50:23.520107 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:23.520038    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 29 19:50:24.520114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:24.520076    2576 patch_prober.go:28] interesting pod/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 29 19:50:24.520522 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:24.520132    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 29 19:50:25.520247 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:25.520206    2576 patch_prober.go:28] interesting pod/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 29 19:50:25.520710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:25.520265    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 29 19:50:26.520193 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:26.520155    2576 patch_prober.go:28] interesting pod/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 29 19:50:26.520381 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:26.520216    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 29 19:50:27.524183 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:27.524146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:27.524622 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:27.524452    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:27.525240 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:27.525224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:50:33.065116 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.065084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:33.384714 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.384627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:33.657507 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.657420    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"]
Jul 29 19:50:33.665025 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.664997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.667687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.667663    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5c1453-openshift-default-dockercfg-jksfx\""
Jul 29 19:50:33.675088 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.675061    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"]
Jul 29 19:50:33.693459 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.693427    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:33.735120 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-socket\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735120 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-podinfo\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4bfe80-e689-49c6-9295-31e4f133787b-istiod-ca-cert\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-token\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cc98\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-kube-api-access-2cc98\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-certs\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-credential-socket\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735521 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-envoy\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.735521 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.735390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-data\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836037 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.835992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-data\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836037 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-socket\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-podinfo\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4bfe80-e689-49c6-9295-31e4f133787b-istiod-ca-cert\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-token\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cc98\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-kube-api-access-2cc98\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-certs\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836308 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-credential-socket\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836678 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-envoy\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836678 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-data\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836678 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836520    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-socket\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836824 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836729    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-certs\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.836899 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.836875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-credential-socket\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.837463 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.837438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4bfe80-e689-49c6-9295-31e4f133787b-istiod-ca-cert\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.838901 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.838876    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-envoy\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.839076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.839059    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-podinfo\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.844086 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.844058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cc98\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-kube-api-access-2cc98\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.844409 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.844388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-token\") pod \"e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") " pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:33.977122 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:33.977039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:34.095826 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.095786    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:34.120513 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.120487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"]
Jul 29 19:50:34.122998 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:50:34.122970    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4bfe80_e689_49c6_9295_31e4f133787b.slice/crio-461d749780e0e2c744ef2f81e77d3e715bc2f04c780c08feec8cd7f338e89b15 WatchSource:0}: Error finding container 461d749780e0e2c744ef2f81e77d3e715bc2f04c780c08feec8cd7f338e89b15: Status 404 returned error can't find the container with id 461d749780e0e2c744ef2f81e77d3e715bc2f04c780c08feec8cd7f338e89b15
Jul 29 19:50:34.125422 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.125389    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:34.125499 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.125455    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:34.125499 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.125487    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:34.268600 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.268559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" event={"ID":"bc4bfe80-e689-49c6-9295-31e4f133787b","Type":"ContainerStarted","Data":"8fde7feaf94938c9c0f0aa82b34c0cd977bb34e4957d29234de5e39930070d82"}
Jul 29 19:50:34.268801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.268655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" event={"ID":"bc4bfe80-e689-49c6-9295-31e4f133787b","Type":"ContainerStarted","Data":"461d749780e0e2c744ef2f81e77d3e715bc2f04c780c08feec8cd7f338e89b15"}
Jul 29 19:50:34.289922 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.289861    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" podStartSLOduration=1.289842842 podStartE2EDuration="1.289842842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:34.287813788 +0000 UTC m=+2128.183631058" watchObservedRunningTime="2026-07-29 19:50:34.289842842 +0000 UTC m=+2128.185660110"
Jul 29 19:50:34.977791 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:34.977744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:35.982117 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:35.982084    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:36.189782 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.189748    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:36.279255 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.279224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:36.280379 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.280357    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:36.289724 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.289691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:36.399296 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.399261    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"]
Jul 29 19:50:36.402667 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.402644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.406356 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.406336    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5c1453-serving-cert\""
Jul 29 19:50:36.416170 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.416147    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"]
Jul 29 19:50:36.442211 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.442173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:36.564327 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.564201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vn6v\" (UniqueName: \"kubernetes.io/projected/12a4a102-d50c-497e-af71-2113dbf27225-kube-api-access-6vn6v\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.564327 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.564293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12a4a102-d50c-497e-af71-2113dbf27225-maas-api-tls\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.564599 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.564369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12a4a102-d50c-497e-af71-2113dbf27225-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.636731 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.636700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:36.665375 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.665342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12a4a102-d50c-497e-af71-2113dbf27225-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.665584 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.665427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vn6v\" (UniqueName: \"kubernetes.io/projected/12a4a102-d50c-497e-af71-2113dbf27225-kube-api-access-6vn6v\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.665584 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.665461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12a4a102-d50c-497e-af71-2113dbf27225-maas-api-tls\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.666024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.666001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12a4a102-d50c-497e-af71-2113dbf27225-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.667829 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.667809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12a4a102-d50c-497e-af71-2113dbf27225-maas-api-tls\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.674403 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.674378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vn6v\" (UniqueName: \"kubernetes.io/projected/12a4a102-d50c-497e-af71-2113dbf27225-kube-api-access-6vn6v\") pod \"maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.714835 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.714810    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:36.860987 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.860957    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"]
Jul 29 19:50:36.861835 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:50:36.861808    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a4a102_d50c_497e_af71_2113dbf27225.slice/crio-1497f99c47670daddf6b30c7fe83614499071f8577e31bbdebf3f1da92a6218a WatchSource:0}: Error finding container 1497f99c47670daddf6b30c7fe83614499071f8577e31bbdebf3f1da92a6218a: Status 404 returned error can't find the container with id 1497f99c47670daddf6b30c7fe83614499071f8577e31bbdebf3f1da92a6218a
Jul 29 19:50:36.956841 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:36.956802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:37.058036 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:37.057998    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:37.286249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:37.286208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz" event={"ID":"12a4a102-d50c-497e-af71-2113dbf27225","Type":"ContainerStarted","Data":"1497f99c47670daddf6b30c7fe83614499071f8577e31bbdebf3f1da92a6218a"}
Jul 29 19:50:38.293761 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:38.293710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz" event={"ID":"12a4a102-d50c-497e-af71-2113dbf27225","Type":"ContainerStarted","Data":"90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe"}
Jul 29 19:50:38.294150 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:38.293784    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:38.311071 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:38.311013    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz" podStartSLOduration=1.9465659789999998 podStartE2EDuration="2.310994285s" totalImagesPullingTime="364.428306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:50:38.308760365 +0000 UTC m=+2132.204577634" watchObservedRunningTime="2026-07-29 19:50:38.310994285 +0000 UTC m=+2132.206811554"
Jul 29 19:50:44.304970 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:44.304939    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:50:51.667704 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:51.666392    2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": read tcp 10.133.0.2:58646->10.133.0.63:15021: read: connection reset by peer" start-of-body=
Jul 29 19:50:51.667704 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:51.666492    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": read tcp 10.133.0.2:58646->10.133.0.63:15021: read: connection reset by peer"
Jul 29 19:50:52.378508 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:52.378471    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerID="8fde7feaf94938c9c0f0aa82b34c0cd977bb34e4957d29234de5e39930070d82" exitCode=0
Jul 29 19:50:52.378697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:52.378560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" event={"ID":"bc4bfe80-e689-49c6-9295-31e4f133787b","Type":"ContainerDied","Data":"8fde7feaf94938c9c0f0aa82b34c0cd977bb34e4957d29234de5e39930070d82"}
Jul 29 19:50:52.378983 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:52.378970    2576 scope.go:117] "RemoveContainer" containerID="8fde7feaf94938c9c0f0aa82b34c0cd977bb34e4957d29234de5e39930070d82"
Jul 29 19:50:52.380094 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:52.380067    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:52.380192 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:52.380175    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:52.380249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:52.380235    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:50:53.386160 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:53.386124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" event={"ID":"bc4bfe80-e689-49c6-9295-31e4f133787b","Type":"ContainerStarted","Data":"adc1b2299bfe430269b7546f251e3f6852efd580643a7d26ff86118110051b1d"}
Jul 29 19:50:53.977590 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:53.977525    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:53.977823 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:53.977800    2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 29 19:50:53.977881 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:53.977860    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 29 19:50:54.977503 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:54.977462    2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 29 19:50:54.977937 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:54.977522    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 29 19:50:55.978071 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:55.978028    2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 29 19:50:55.978484 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:55.978096    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 29 19:50:56.977660 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:56.977621    2576 patch_prober.go:28] interesting pod/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 29 19:50:56.977860 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:56.977678    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 29 19:50:57.981573 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:57.981470    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:57.982036 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:57.981888    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:50:57.982577 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:50:57.982534    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:51:01.158215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:51:01.158176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:51:07.746984 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:51:07.746949    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:51:46.865731 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:51:46.865694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:26.087112 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:26.087078    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:27.145387 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.145349    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"]
Jul 29 19:52:27.148843 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.148825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"
Jul 29 19:52:27.151049 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.151031    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 19:52:27.156187 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.156090    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"]
Jul 29 19:52:27.178994 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.178959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d360609-208f-43f7-8f7d-018f10c9ce97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7\" (UID: \"5d360609-208f-43f7-8f7d-018f10c9ce97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"
Jul 29 19:52:27.280158 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.280118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d360609-208f-43f7-8f7d-018f10c9ce97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7\" (UID: \"5d360609-208f-43f7-8f7d-018f10c9ce97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"
Jul 29 19:52:27.280760 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.280740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d360609-208f-43f7-8f7d-018f10c9ce97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7\" (UID: \"5d360609-208f-43f7-8f7d-018f10c9ce97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"
Jul 29 19:52:27.462202 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.462097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"
Jul 29 19:52:27.463198 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.463169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:27.598350 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.598316    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"]
Jul 29 19:52:27.601597 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:52:27.601564    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d360609_208f_43f7_8f7d_018f10c9ce97.slice/crio-bc20c51a6d76985cbeed02306421970ade4ef4eb7b4e5787773a5121ae9206bb WatchSource:0}: Error finding container bc20c51a6d76985cbeed02306421970ade4ef4eb7b4e5787773a5121ae9206bb: Status 404 returned error can't find the container with id bc20c51a6d76985cbeed02306421970ade4ef4eb7b4e5787773a5121ae9206bb
Jul 29 19:52:27.887937 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.887856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7" event={"ID":"5d360609-208f-43f7-8f7d-018f10c9ce97","Type":"ContainerStarted","Data":"76a37743973690670b7397a84082d729ac7e532ade38da17bfec185e46a104db"}
Jul 29 19:52:27.887937 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.887921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7" event={"ID":"5d360609-208f-43f7-8f7d-018f10c9ce97","Type":"ContainerStarted","Data":"bc20c51a6d76985cbeed02306421970ade4ef4eb7b4e5787773a5121ae9206bb"}
Jul 29 19:52:27.903956 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:27.903898    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7" podStartSLOduration=0.903881458 podStartE2EDuration="903.881458ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:52:27.902359949 +0000 UTC m=+2241.798177220" watchObservedRunningTime="2026-07-29 19:52:27.903881458 +0000 UTC m=+2241.799698728"
Jul 29 19:52:28.894347 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:28.894316    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d360609-208f-43f7-8f7d-018f10c9ce97" containerID="76a37743973690670b7397a84082d729ac7e532ade38da17bfec185e46a104db" exitCode=0
Jul 29 19:52:28.894783 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:28.894393    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7" event={"ID":"5d360609-208f-43f7-8f7d-018f10c9ce97","Type":"ContainerDied","Data":"76a37743973690670b7397a84082d729ac7e532ade38da17bfec185e46a104db"}
Jul 29 19:52:30.030275 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:30.030250    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"
Jul 29 19:52:30.104849 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:30.104811    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d360609-208f-43f7-8f7d-018f10c9ce97-maas-api-service-ca\") pod \"5d360609-208f-43f7-8f7d-018f10c9ce97\" (UID: \"5d360609-208f-43f7-8f7d-018f10c9ce97\") "
Jul 29 19:52:30.105194 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:30.105170    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d360609-208f-43f7-8f7d-018f10c9ce97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d360609-208f-43f7-8f7d-018f10c9ce97" (UID: "5d360609-208f-43f7-8f7d-018f10c9ce97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:30.206023 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:30.205932    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d360609-208f-43f7-8f7d-018f10c9ce97-maas-api-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:30.906238 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:30.906202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7" event={"ID":"5d360609-208f-43f7-8f7d-018f10c9ce97","Type":"ContainerDied","Data":"bc20c51a6d76985cbeed02306421970ade4ef4eb7b4e5787773a5121ae9206bb"}
Jul 29 19:52:30.906415 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:30.906259    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"
Jul 29 19:52:30.906415 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:30.906264    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc20c51a6d76985cbeed02306421970ade4ef4eb7b4e5787773a5121ae9206bb"
Jul 29 19:52:37.570520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.570480    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"]
Jul 29 19:52:37.571036 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.570798    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" podUID="74818d7b-9847-4149-b92f-0a84468d5df9" containerName="maas-api" containerID="cri-o://9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2" gracePeriod=30
Jul 29 19:52:37.596315 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.596256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:37.669200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.669166    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:37.732120 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.732080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:37.783864 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.783831    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"]
Jul 29 19:52:37.792670 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.792629    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4d9536-8b9w7"]
Jul 29 19:52:37.832444 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.832411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:37.836534 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.836511    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:52:37.879419 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.879386    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls\") pod \"74818d7b-9847-4149-b92f-0a84468d5df9\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") "
Jul 29 19:52:37.879419 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.879429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dnd4\" (UniqueName: \"kubernetes.io/projected/74818d7b-9847-4149-b92f-0a84468d5df9-kube-api-access-7dnd4\") pod \"74818d7b-9847-4149-b92f-0a84468d5df9\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") "
Jul 29 19:52:37.879721 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.879481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74818d7b-9847-4149-b92f-0a84468d5df9-openshift-service-ca\") pod \"74818d7b-9847-4149-b92f-0a84468d5df9\" (UID: \"74818d7b-9847-4149-b92f-0a84468d5df9\") "
Jul 29 19:52:37.879929 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.879903    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74818d7b-9847-4149-b92f-0a84468d5df9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "74818d7b-9847-4149-b92f-0a84468d5df9" (UID: "74818d7b-9847-4149-b92f-0a84468d5df9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:37.881717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.881689    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "74818d7b-9847-4149-b92f-0a84468d5df9" (UID: "74818d7b-9847-4149-b92f-0a84468d5df9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:52:37.881717 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.881707    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74818d7b-9847-4149-b92f-0a84468d5df9-kube-api-access-7dnd4" (OuterVolumeSpecName: "kube-api-access-7dnd4") pod "74818d7b-9847-4149-b92f-0a84468d5df9" (UID: "74818d7b-9847-4149-b92f-0a84468d5df9"). InnerVolumeSpecName "kube-api-access-7dnd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:37.944259 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.944224    2576 generic.go:356] "Generic (PLEG): container finished" podID="74818d7b-9847-4149-b92f-0a84468d5df9" containerID="9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2" exitCode=0
Jul 29 19:52:37.944421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.944270    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"
Jul 29 19:52:37.944421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.944311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" event={"ID":"74818d7b-9847-4149-b92f-0a84468d5df9","Type":"ContainerDied","Data":"9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2"}
Jul 29 19:52:37.944421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.944366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl" event={"ID":"74818d7b-9847-4149-b92f-0a84468d5df9","Type":"ContainerDied","Data":"e9b0d5cb23a43131ced54c4a79718b9f70953af2d8c0682a4b7281b4fc366a2b"}
Jul 29 19:52:37.944421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.944390    2576 scope.go:117] "RemoveContainer" containerID="9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2"
Jul 29 19:52:37.955805 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.955786    2576 scope.go:117] "RemoveContainer" containerID="9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2"
Jul 29 19:52:37.956123 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:52:37.956103    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2\": container with ID starting with 9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2 not found: ID does not exist" containerID="9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2"
Jul 29 19:52:37.956178 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.956132    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2"} err="failed to get container status \"9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2\": rpc error: code = NotFound desc = could not find container \"9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2\": container with ID starting with 9a8857c4af08a6b6f25c156762301d0ae9381ae76285f850c3bec7e23390a2b2 not found: ID does not exist"
Jul 29 19:52:37.967408 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.967370    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"]
Jul 29 19:52:37.973811 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.973779    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4d9536-86577bd9df-ng2nl"]
Jul 29 19:52:37.981002 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.980978    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74818d7b-9847-4149-b92f-0a84468d5df9-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:37.981002 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.981004    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74818d7b-9847-4149-b92f-0a84468d5df9-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:37.981147 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:37.981014    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dnd4\" (UniqueName: \"kubernetes.io/projected/74818d7b-9847-4149-b92f-0a84468d5df9-kube-api-access-7dnd4\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.153871 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:38.153782    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:38.718758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:38.718726    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d360609-208f-43f7-8f7d-018f10c9ce97" path="/var/lib/kubelet/pods/5d360609-208f-43f7-8f7d-018f10c9ce97/volumes"
Jul 29 19:52:38.719171 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:38.719155    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74818d7b-9847-4149-b92f-0a84468d5df9" path="/var/lib/kubelet/pods/74818d7b-9847-4149-b92f-0a84468d5df9/volumes"
Jul 29 19:52:43.891972 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:43.891933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:43.994337 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:43.994302    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:44.185269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:44.185178    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"]
Jul 29 19:52:44.185502 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:44.185444    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy" containerID="cri-o://a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d" gracePeriod=30
Jul 29 19:52:44.201881 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:44.201849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:44.460568 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:44.460448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:49.437246 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.437218    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:52:49.587415 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-data\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587415 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-token\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587440    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-podinfo\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587497    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istiod-ca-cert\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587524    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-certs\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587570    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-credential-socket\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587608    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhtb4\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-kube-api-access-xhtb4\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587663    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-socket\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.587722 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587691    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-envoy\") pod \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\" (UID: \"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd\") "
Jul 29 19:52:49.588091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587915    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:49.588091 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.587985    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:49.588573 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.588101    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:49.588573 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.588179    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:49.588573 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.588424    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:49.589872 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.589839    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-kube-api-access-xhtb4" (OuterVolumeSpecName: "kube-api-access-xhtb4") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "kube-api-access-xhtb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:49.589872 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.589854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:49.590024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.589987    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:49.590024 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.590004    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" (UID: "ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:52:49.689316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689273    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689307    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689315    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689316 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689325    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhtb4\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-kube-api-access-xhtb4\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689334    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689343    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689353    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689360    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:49.689621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:49.689368    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:50.009145 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.009111    2576 generic.go:356] "Generic (PLEG): container finished" podID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerID="a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d" exitCode=0
Jul 29 19:52:50.009319 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.009164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"
Jul 29 19:52:50.009319 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.009163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" event={"ID":"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd","Type":"ContainerDied","Data":"a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d"}
Jul 29 19:52:50.009319 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.009289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn" event={"ID":"ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd","Type":"ContainerDied","Data":"dce837216ad81d28d7ca44348289614575dd830a28c0d10634f4681e6f8efdfb"}
Jul 29 19:52:50.009319 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.009320    2576 scope.go:117] "RemoveContainer" containerID="a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d"
Jul 29 19:52:50.024934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.024910    2576 scope.go:117] "RemoveContainer" containerID="96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c"
Jul 29 19:52:50.033600 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.033577    2576 scope.go:117] "RemoveContainer" containerID="a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d"
Jul 29 19:52:50.033927 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:52:50.033904    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d\": container with ID starting with a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d not found: ID does not exist" containerID="a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d"
Jul 29 19:52:50.033981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.033938    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d"} err="failed to get container status \"a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d\": rpc error: code = NotFound desc = could not find container \"a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d\": container with ID starting with a32a7f9b7e6a057b4d6d3d3b1e968ac7389cb6e299ddd1149909aca9eb291e2d not found: ID does not exist"
Jul 29 19:52:50.033981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.033957    2576 scope.go:117] "RemoveContainer" containerID="96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c"
Jul 29 19:52:50.034235 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:52:50.034203    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c\": container with ID starting with 96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c not found: ID does not exist" containerID="96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c"
Jul 29 19:52:50.034291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.034239    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c"} err="failed to get container status \"96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c\": rpc error: code = NotFound desc = could not find container \"96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c\": container with ID starting with 96d92f45f50f32d8ab0ef6ffc615ba46de8883fe1a7bc8a633ebf091821b2c3c not found: ID does not exist"
Jul 29 19:52:50.036998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.036974    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"]
Jul 29 19:52:50.041321 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.041300    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4d9536-openshift-default-679df6499b-kwfvn"]
Jul 29 19:52:50.715610 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:50.715576    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" path="/var/lib/kubelet/pods/ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd/volumes"
Jul 29 19:52:55.003981 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.003944    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"]
Jul 29 19:52:55.004376 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.004169    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz" podUID="12a4a102-d50c-497e-af71-2113dbf27225" containerName="maas-api" containerID="cri-o://90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe" gracePeriod=30
Jul 29 19:52:55.019440 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.019411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:55.091104 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.091072    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:55.164129 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.164093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:55.231741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.231704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:55.266889 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.266813    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:52:55.442504 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.442464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12a4a102-d50c-497e-af71-2113dbf27225-openshift-service-ca\") pod \"12a4a102-d50c-497e-af71-2113dbf27225\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") "
Jul 29 19:52:55.442714 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.442581    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12a4a102-d50c-497e-af71-2113dbf27225-maas-api-tls\") pod \"12a4a102-d50c-497e-af71-2113dbf27225\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") "
Jul 29 19:52:55.442714 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.442619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vn6v\" (UniqueName: \"kubernetes.io/projected/12a4a102-d50c-497e-af71-2113dbf27225-kube-api-access-6vn6v\") pod \"12a4a102-d50c-497e-af71-2113dbf27225\" (UID: \"12a4a102-d50c-497e-af71-2113dbf27225\") "
Jul 29 19:52:55.442928 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.442902    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12a4a102-d50c-497e-af71-2113dbf27225-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12a4a102-d50c-497e-af71-2113dbf27225" (UID: "12a4a102-d50c-497e-af71-2113dbf27225"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:52:55.444705 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.444682    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12a4a102-d50c-497e-af71-2113dbf27225-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12a4a102-d50c-497e-af71-2113dbf27225" (UID: "12a4a102-d50c-497e-af71-2113dbf27225"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:52:55.444896 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.444873    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12a4a102-d50c-497e-af71-2113dbf27225-kube-api-access-6vn6v" (OuterVolumeSpecName: "kube-api-access-6vn6v") pod "12a4a102-d50c-497e-af71-2113dbf27225" (UID: "12a4a102-d50c-497e-af71-2113dbf27225"). InnerVolumeSpecName "kube-api-access-6vn6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:55.544276 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.544185    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12a4a102-d50c-497e-af71-2113dbf27225-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:55.544276 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.544216    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12a4a102-d50c-497e-af71-2113dbf27225-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:55.544276 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.544225    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vn6v\" (UniqueName: \"kubernetes.io/projected/12a4a102-d50c-497e-af71-2113dbf27225-kube-api-access-6vn6v\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:52:55.590943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:55.590904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:56.043747 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.043713    2576 generic.go:356] "Generic (PLEG): container finished" podID="12a4a102-d50c-497e-af71-2113dbf27225" containerID="90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe" exitCode=0
Jul 29 19:52:56.044241 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.043773    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"
Jul 29 19:52:56.044241 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.043800    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz" event={"ID":"12a4a102-d50c-497e-af71-2113dbf27225","Type":"ContainerDied","Data":"90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe"}
Jul 29 19:52:56.044241 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.043864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz" event={"ID":"12a4a102-d50c-497e-af71-2113dbf27225","Type":"ContainerDied","Data":"1497f99c47670daddf6b30c7fe83614499071f8577e31bbdebf3f1da92a6218a"}
Jul 29 19:52:56.044241 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.043893    2576 scope.go:117] "RemoveContainer" containerID="90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe"
Jul 29 19:52:56.053477 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.053456    2576 scope.go:117] "RemoveContainer" containerID="90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe"
Jul 29 19:52:56.053828 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:52:56.053805    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe\": container with ID starting with 90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe not found: ID does not exist" containerID="90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe"
Jul 29 19:52:56.053912 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.053835    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe"} err="failed to get container status \"90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe\": rpc error: code = NotFound desc = could not find container \"90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe\": container with ID starting with 90a436153dd00f435add473897e36468d7d338fe1a4221b50ce2f4dc788f6dfe not found: ID does not exist"
Jul 29 19:52:56.068376 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.068336    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"]
Jul 29 19:52:56.072068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.072026    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5c1453-7fd8765996-xt4jz"]
Jul 29 19:52:56.716714 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:52:56.716682    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12a4a102-d50c-497e-af71-2113dbf27225" path="/var/lib/kubelet/pods/12a4a102-d50c-497e-af71-2113dbf27225/volumes"
Jul 29 19:53:01.710878 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:01.710846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:01.771256 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:01.771224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:01.969630 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:01.969480    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"]
Jul 29 19:53:01.969802 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:01.969740    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy" containerID="cri-o://adc1b2299bfe430269b7546f251e3f6852efd580643a7d26ff86118110051b1d" gracePeriod=30
Jul 29 19:53:01.995790 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:01.995757    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:02.217979 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.217943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:02.712710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.712676    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:02.997417 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997337    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"]
Jul 29 19:53:02.997698 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997685    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d360609-208f-43f7-8f7d-018f10c9ce97" containerName="revoke-keys"
Jul 29 19:53:02.997750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997700    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d360609-208f-43f7-8f7d-018f10c9ce97" containerName="revoke-keys"
Jul 29 19:53:02.997750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997712    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy"
Jul 29 19:53:02.997750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997718    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy"
Jul 29 19:53:02.997750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997728    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy"
Jul 29 19:53:02.997750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997734    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy"
Jul 29 19:53:02.997750 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997749    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a4a102-d50c-497e-af71-2113dbf27225" containerName="maas-api"
Jul 29 19:53:02.997934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997754    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a4a102-d50c-497e-af71-2113dbf27225" containerName="maas-api"
Jul 29 19:53:02.997934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997762    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74818d7b-9847-4149-b92f-0a84468d5df9" containerName="maas-api"
Jul 29 19:53:02.997934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997768    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="74818d7b-9847-4149-b92f-0a84468d5df9" containerName="maas-api"
Jul 29 19:53:02.997934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997815    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d360609-208f-43f7-8f7d-018f10c9ce97" containerName="revoke-keys"
Jul 29 19:53:02.997934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997822    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy"
Jul 29 19:53:02.997934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997828    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="74818d7b-9847-4149-b92f-0a84468d5df9" containerName="maas-api"
Jul 29 19:53:02.997934 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:02.997835    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a4a102-d50c-497e-af71-2113dbf27225" containerName="maas-api"
Jul 29 19:53:03.002183 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.002161    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.004731 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.004701    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a62265-openshift-default-dockercfg-m4hkn\""
Jul 29 19:53:03.013891 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.013868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"]
Jul 29 19:53:03.032567 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.032511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:03.110988 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.110950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-envoy\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-podinfo\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-credential-socket\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8r7m\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-kube-api-access-d8r7m\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111190 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111161    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-token\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111386 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-socket\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111386 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istiod-ca-cert\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111386 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-data\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.111386 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.111322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-certs\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.212432 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-podinfo\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.212432 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-credential-socket\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.212736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8r7m\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-kube-api-access-d8r7m\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.212736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-token\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.212736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-socket\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.212736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istiod-ca-cert\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213049 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-data\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213049 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-credential-socket\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213049 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.212961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-certs\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213049 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.213017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-envoy\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.213072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-socket\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.213159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-data\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.213235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-certs\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.213451 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.213431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istiod-ca-cert\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.215067 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.215042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-envoy\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.215322 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.215301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-podinfo\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.220222 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.220197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-token\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.220398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.220379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8r7m\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-kube-api-access-d8r7m\") pod \"e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") " pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.313730 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.313698    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:03.427761 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.427722    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:03.457676 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.457648    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"]
Jul 29 19:53:03.459754 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:53:03.459727    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc247ff55_c4a1_4536_a81c_cd0a51dc5369.slice/crio-0a416f675115b8ebc6c5cd855fa7e9b4d40ad9e498e4a8930c9282c37366e0dd WatchSource:0}: Error finding container 0a416f675115b8ebc6c5cd855fa7e9b4d40ad9e498e4a8930c9282c37366e0dd: Status 404 returned error can't find the container with id 0a416f675115b8ebc6c5cd855fa7e9b4d40ad9e498e4a8930c9282c37366e0dd
Jul 29 19:53:03.462250 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.462218    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:03.462344 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.462279    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:03.462344 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:03.462310    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:04.090580 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:04.090530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" event={"ID":"c247ff55-c4a1-4536-a81c-cd0a51dc5369","Type":"ContainerStarted","Data":"22ef7a234d13f072096186a936610e90c9f8337dff0652130896251207f16106"}
Jul 29 19:53:04.091000 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:04.090599    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" event={"ID":"c247ff55-c4a1-4536-a81c-cd0a51dc5369","Type":"ContainerStarted","Data":"0a416f675115b8ebc6c5cd855fa7e9b4d40ad9e498e4a8930c9282c37366e0dd"}
Jul 29 19:53:04.112853 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:04.112797    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" podStartSLOduration=2.112780008 podStartE2EDuration="2.112780008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:04.110331757 +0000 UTC m=+2278.006149027" watchObservedRunningTime="2026-07-29 19:53:04.112780008 +0000 UTC m=+2278.008597276"
Jul 29 19:53:04.314621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:04.314586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:04.319434 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:04.319407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:05.095784 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:05.095750    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:05.096648 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:05.096628    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:05.996839 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:05.996796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:06.094340 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.094295    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:06.113677 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.113644    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"]
Jul 29 19:53:06.114076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.114060    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac52bee2-f276-4cdd-a5b9-aa5bc39d8ebd" containerName="istio-proxy"
Jul 29 19:53:06.117065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.117049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.119238 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.119217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a62265-serving-cert\""
Jul 29 19:53:06.126877 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.126854    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"]
Jul 29 19:53:06.140579 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.140531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbq9f\" (UniqueName: \"kubernetes.io/projected/4789c782-010f-4b2d-a963-18f1d4b3d09c-kube-api-access-tbq9f\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.140771 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.140749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4789c782-010f-4b2d-a963-18f1d4b3d09c-openshift-service-ca\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.140858 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.140807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.202511 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.202480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:06.241868 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.241830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.242047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.241881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbq9f\" (UniqueName: \"kubernetes.io/projected/4789c782-010f-4b2d-a963-18f1d4b3d09c-kube-api-access-tbq9f\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.242047 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.241951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4789c782-010f-4b2d-a963-18f1d4b3d09c-openshift-service-ca\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.242047 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:53:06.241978    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-serving-cert: secret "maas-api-e2e-api-a-a62265-serving-cert" not found
Jul 29 19:53:06.242047 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:53:06.242048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls podName:4789c782-010f-4b2d-a963-18f1d4b3d09c nodeName:}" failed. No retries permitted until 2026-07-29 19:53:06.742027614 +0000 UTC m=+2280.637844880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls") pod "maas-api-e2e-api-a-a62265-75448f5d57-48nc5" (UID: "4789c782-010f-4b2d-a963-18f1d4b3d09c") : secret "maas-api-e2e-api-a-a62265-serving-cert" not found
Jul 29 19:53:06.242589 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.242573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4789c782-010f-4b2d-a963-18f1d4b3d09c-openshift-service-ca\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.251165 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.251105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbq9f\" (UniqueName: \"kubernetes.io/projected/4789c782-010f-4b2d-a963-18f1d4b3d09c-kube-api-access-tbq9f\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.386792 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.386760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:06.682035 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.682002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:06.748414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.748377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.750990 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.750962    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls\") pod \"maas-api-e2e-api-a-a62265-75448f5d57-48nc5\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:06.777997 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:06.777962    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:07.028583 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.028529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:07.110641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.110610    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerID="adc1b2299bfe430269b7546f251e3f6852efd580643a7d26ff86118110051b1d" exitCode=0
Jul 29 19:53:07.110805 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.110687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" event={"ID":"bc4bfe80-e689-49c6-9295-31e4f133787b","Type":"ContainerDied","Data":"adc1b2299bfe430269b7546f251e3f6852efd580643a7d26ff86118110051b1d"}
Jul 29 19:53:07.110805 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.110772    2576 scope.go:117] "RemoveContainer" containerID="8fde7feaf94938c9c0f0aa82b34c0cd977bb34e4957d29234de5e39930070d82"
Jul 29 19:53:07.196777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.193326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"]
Jul 29 19:53:07.203571 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:53:07.203124    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4789c782_010f_4b2d_a963_18f1d4b3d09c.slice/crio-5af5b28f45591a249bde17d9dc0fd68b4ab44520e543ee3583757f1e2e8587f8 WatchSource:0}: Error finding container 5af5b28f45591a249bde17d9dc0fd68b4ab44520e543ee3583757f1e2e8587f8: Status 404 returned error can't find the container with id 5af5b28f45591a249bde17d9dc0fd68b4ab44520e543ee3583757f1e2e8587f8
Jul 29 19:53:07.205972 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.205946    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:53:07.274443 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.274414    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:53:07.356146 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356117    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-socket\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356325 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356162    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4bfe80-e689-49c6-9295-31e4f133787b-istiod-ca-cert\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356325 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356205    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-credential-socket\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356325 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356224    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-envoy\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356325 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356268    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cc98\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-kube-api-access-2cc98\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356393    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-certs\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:53:07.356618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356426    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-data\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356450    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-token\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-podinfo\") pod \"bc4bfe80-e689-49c6-9295-31e4f133787b\" (UID: \"bc4bfe80-e689-49c6-9295-31e4f133787b\") "
Jul 29 19:53:07.356618 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356578    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:53:07.356954 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356628    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:53:07.356954 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356737    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc4bfe80-e689-49c6-9295-31e4f133787b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:53:07.356954 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356876    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.356954 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356897    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc4bfe80-e689-49c6-9295-31e4f133787b-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.356954 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356920    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.356954 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.356934    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.357352 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.357319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:53:07.358758 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.358732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:53:07.358863 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.358762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-kube-api-access-2cc98" (OuterVolumeSpecName: "kube-api-access-2cc98") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "kube-api-access-2cc98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:53:07.358863 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.358772    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:53:07.358863 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.358833    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc4bfe80-e689-49c6-9295-31e4f133787b" (UID: "bc4bfe80-e689-49c6-9295-31e4f133787b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:53:07.457598 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.457566    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.457598 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.457593    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cc98\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-kube-api-access-2cc98\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.457598 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.457603    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.457841 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.457612    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:07.457841 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:07.457620    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc4bfe80-e689-49c6-9295-31e4f133787b-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:53:08.118219 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.118132    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"
Jul 29 19:53:08.118219 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.118143    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8" event={"ID":"bc4bfe80-e689-49c6-9295-31e4f133787b","Type":"ContainerDied","Data":"461d749780e0e2c744ef2f81e77d3e715bc2f04c780c08feec8cd7f338e89b15"}
Jul 29 19:53:08.118219 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.118213    2576 scope.go:117] "RemoveContainer" containerID="adc1b2299bfe430269b7546f251e3f6852efd580643a7d26ff86118110051b1d"
Jul 29 19:53:08.120162 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.120136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5" event={"ID":"4789c782-010f-4b2d-a963-18f1d4b3d09c","Type":"ContainerStarted","Data":"d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67"}
Jul 29 19:53:08.120281 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.120195    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:08.120281 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.120219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5" event={"ID":"4789c782-010f-4b2d-a963-18f1d4b3d09c","Type":"ContainerStarted","Data":"5af5b28f45591a249bde17d9dc0fd68b4ab44520e543ee3583757f1e2e8587f8"}
Jul 29 19:53:08.137803 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.137751    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5" podStartSLOduration=1.5621187490000001 podStartE2EDuration="2.137732529s" totalImagesPullingTime="575.61378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:08.136040335 +0000 UTC m=+2282.031857608" watchObservedRunningTime="2026-07-29 19:53:08.137732529 +0000 UTC m=+2282.033549798"
Jul 29 19:53:08.149861 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.149827    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"]
Jul 29 19:53:08.158023 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.157988    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5c1453-openshift-default-55d5855686-p4bh8"]
Jul 29 19:53:08.714562 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:08.714515    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" path="/var/lib/kubelet/pods/bc4bfe80-e689-49c6-9295-31e4f133787b/volumes"
Jul 29 19:53:14.132065 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:14.132031    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:53:19.198429 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:19.198386    2576 generic.go:356] "Generic (PLEG): container finished" podID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerID="22ef7a234d13f072096186a936610e90c9f8337dff0652130896251207f16106" exitCode=0
Jul 29 19:53:19.198429 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:19.198434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" event={"ID":"c247ff55-c4a1-4536-a81c-cd0a51dc5369","Type":"ContainerDied","Data":"22ef7a234d13f072096186a936610e90c9f8337dff0652130896251207f16106"}
Jul 29 19:53:19.198932 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:19.198832    2576 scope.go:117] "RemoveContainer" containerID="22ef7a234d13f072096186a936610e90c9f8337dff0652130896251207f16106"
Jul 29 19:53:19.199946 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:19.199914    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:19.200021 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:19.200004    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:19.200070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:19.200057    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:20.096120 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:20.096086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:20.206293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:20.206257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" event={"ID":"c247ff55-c4a1-4536-a81c-cd0a51dc5369","Type":"ContainerStarted","Data":"502b0055d170639c2799ceee6a8c71f33bdd521b23364d73b43e082cb315215e"}
Jul 29 19:53:20.314624 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:20.314583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:20.315842 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:20.315820    2576 patch_prober.go:28] interesting pod/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 29 19:53:20.315961 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:20.315863    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 29 19:53:21.314745 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:21.314707    2576 patch_prober.go:28] interesting pod/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 29 19:53:21.315144 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:21.314761    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 29 19:53:22.314826 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:22.314783    2576 patch_prober.go:28] interesting pod/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 29 19:53:22.315225 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:22.314859    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 29 19:53:23.147349 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:23.147314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:23.314821 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:23.314779    2576 patch_prober.go:28] interesting pod/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 29 19:53:23.315006 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:23.314839    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 29 19:53:24.318673 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:24.318639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:24.319087 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:24.318911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:24.319701 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:24.319684    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:53:30.989410 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:30.989337    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:31.470277 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.470246    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:31.767398 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.767363    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"]
Jul 29 19:53:31.767910 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.767892    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy"
Jul 29 19:53:31.767962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.767913    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy"
Jul 29 19:53:31.767962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.767935    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy"
Jul 29 19:53:31.767962 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.767945    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy"
Jul 29 19:53:31.768080 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.768024    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy"
Jul 29 19:53:31.768080 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.768035    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4bfe80-e689-49c6-9295-31e4f133787b" containerName="istio-proxy"
Jul 29 19:53:31.771570 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.771531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.773696 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.773675    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3adaab-openshift-default-dockercfg-mghtc\""
Jul 29 19:53:31.782111 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.782088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"]
Jul 29 19:53:31.802207 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.802172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:31.871114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-envoy\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-socket\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a095e-4e15-4c03-b668-0410f6bc478c-istiod-ca-cert\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c25cw\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-kube-api-access-c25cw\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-podinfo\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871297 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-credential-socket\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871523 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-certs\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871523 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-token\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.871523 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.871461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-data\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972457 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-certs\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972457 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-token\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-data\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-envoy\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-socket\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a095e-4e15-4c03-b668-0410f6bc478c-istiod-ca-cert\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c25cw\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-kube-api-access-c25cw\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.972763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-podinfo\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.973090 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-credential-socket\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.973090 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-certs\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.973090 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.972987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-data\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.973090 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.973074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-socket\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.973303 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.973170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-credential-socket\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.973355 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.973301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a095e-4e15-4c03-b668-0410f6bc478c-istiod-ca-cert\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.974806 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.974784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-envoy\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.975296 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.975276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-podinfo\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.981516 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.981495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-token\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:31.981777 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:31.981758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c25cw\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-kube-api-access-c25cw\") pod \"e2e-api-b-3adaab-openshift-default-659664b78-l8skx\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") " pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:32.082943 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:32.082853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:32.089721 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:32.089682    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:32.223282 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:32.223248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"]
Jul 29 19:53:32.225005 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:53:32.224979    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7a095e_4e15_4c03_b668_0410f6bc478c.slice/crio-f3f406264ff122596ad2ccb741dfc27daac75d6c2de834a097883fd00096513b WatchSource:0}: Error finding container f3f406264ff122596ad2ccb741dfc27daac75d6c2de834a097883fd00096513b: Status 404 returned error can't find the container with id f3f406264ff122596ad2ccb741dfc27daac75d6c2de834a097883fd00096513b
Jul 29 19:53:32.227672 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:32.227636    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:32.227751 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:32.227700    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:32.227751 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:32.227726    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:32.279610 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:32.279577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" event={"ID":"cc7a095e-4e15-4c03-b668-0410f6bc478c","Type":"ContainerStarted","Data":"f3f406264ff122596ad2ccb741dfc27daac75d6c2de834a097883fd00096513b"}
Jul 29 19:53:33.286591 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:33.286536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" event={"ID":"cc7a095e-4e15-4c03-b668-0410f6bc478c","Type":"ContainerStarted","Data":"d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756"}
Jul 29 19:53:33.307556 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:33.307494    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" podStartSLOduration=2.307477218 podStartE2EDuration="2.307477218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:33.304885706 +0000 UTC m=+2307.200702975" watchObservedRunningTime="2026-07-29 19:53:33.307477218 +0000 UTC m=+2307.203294557"
Jul 29 19:53:34.083285 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:34.083238    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:34.088460 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:34.088430    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:34.292621 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:34.292590    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:34.293664 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:34.293644    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:35.269452 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.269418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:35.344161 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.344118    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"]
Jul 29 19:53:35.347972 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.347946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.349968 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.349950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-3adaab-serving-cert\""
Jul 29 19:53:35.362249 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.362215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"]
Jul 29 19:53:35.363946 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.363912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:35.402433 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.402398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.402641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.402535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28003896-4d3c-4d1d-924d-af1c73d68ba5-openshift-service-ca\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.402641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.402596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wh2\" (UniqueName: \"kubernetes.io/projected/28003896-4d3c-4d1d-924d-af1c73d68ba5-kube-api-access-f9wh2\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.459102 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.459054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:35.503414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.503371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.503838 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.503456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28003896-4d3c-4d1d-924d-af1c73d68ba5-openshift-service-ca\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.503838 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.503489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wh2\" (UniqueName: \"kubernetes.io/projected/28003896-4d3c-4d1d-924d-af1c73d68ba5-kube-api-access-f9wh2\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.503838 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:53:35.503531    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-serving-cert: secret "maas-api-e2e-api-b-3adaab-serving-cert" not found
Jul 29 19:53:35.503838 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:53:35.503643    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls podName:28003896-4d3c-4d1d-924d-af1c73d68ba5 nodeName:}" failed. No retries permitted until 2026-07-29 19:53:36.003622704 +0000 UTC m=+2309.899439966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls") pod "maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz" (UID: "28003896-4d3c-4d1d-924d-af1c73d68ba5") : secret "maas-api-e2e-api-b-3adaab-serving-cert" not found
Jul 29 19:53:35.504150 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.504130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28003896-4d3c-4d1d-924d-af1c73d68ba5-openshift-service-ca\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.516432 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.516394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wh2\" (UniqueName: \"kubernetes.io/projected/28003896-4d3c-4d1d-924d-af1c73d68ba5-kube-api-access-f9wh2\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:35.710739 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:35.710655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:36.008171 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:36.008133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:36.010738 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:36.010712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls\") pod \"maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:36.010992 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:36.010974    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:36.112698 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:36.112664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:53:36.260845 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:36.260759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:36.401179 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:36.401148    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"]
Jul 29 19:53:36.402899 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:53:36.402871    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28003896_4d3c_4d1d_924d_af1c73d68ba5.slice/crio-c831ae8f2fa44bf5d213ef5ec6f012aee15be11428b14ff4454716a01f4bf645 WatchSource:0}: Error finding container c831ae8f2fa44bf5d213ef5ec6f012aee15be11428b14ff4454716a01f4bf645: Status 404 returned error can't find the container with id c831ae8f2fa44bf5d213ef5ec6f012aee15be11428b14ff4454716a01f4bf645
Jul 29 19:53:37.312498 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:37.312459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz" event={"ID":"28003896-4d3c-4d1d-924d-af1c73d68ba5","Type":"ContainerStarted","Data":"c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c"}
Jul 29 19:53:37.312797 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:37.312564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz" event={"ID":"28003896-4d3c-4d1d-924d-af1c73d68ba5","Type":"ContainerStarted","Data":"c831ae8f2fa44bf5d213ef5ec6f012aee15be11428b14ff4454716a01f4bf645"}
Jul 29 19:53:37.312797 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:37.312672    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:37.332952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:37.332876    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz" podStartSLOduration=1.921625305 podStartE2EDuration="2.332851096s" totalImagesPullingTime="411.225791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:53:37.329690756 +0000 UTC m=+2311.225508248" watchObservedRunningTime="2026-07-29 19:53:37.332851096 +0000 UTC m=+2311.228668366"
Jul 29 19:53:43.323414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:43.323385    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:53:49.294767 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.294729    2576 patch_prober.go:28] interesting pod/e2e-api-b-3adaab-openshift-default-659664b78-l8skx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 19:53:49.295311 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.294802    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 19:53:49.388456 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.388366    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerID="d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756" exitCode=0
Jul 29 19:53:49.388625 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.388444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" event={"ID":"cc7a095e-4e15-4c03-b668-0410f6bc478c","Type":"ContainerDied","Data":"d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756"}
Jul 29 19:53:49.388880 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.388866    2576 scope.go:117] "RemoveContainer" containerID="d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756"
Jul 29 19:53:49.389939 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.389911    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:49.390070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.389993    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:49.390070 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:49.390041    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:53:50.394959 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:50.394924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" event={"ID":"cc7a095e-4e15-4c03-b668-0410f6bc478c","Type":"ContainerStarted","Data":"e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e"}
Jul 29 19:53:51.083724 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:51.083687    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:51.084030 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:51.084008    2576 patch_prober.go:28] interesting pod/e2e-api-b-3adaab-openshift-default-659664b78-l8skx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 19:53:51.084078 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:51.084055    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 19:53:52.083637 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:52.083590    2576 patch_prober.go:28] interesting pod/e2e-api-b-3adaab-openshift-default-659664b78-l8skx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 19:53:52.084121 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:52.083658    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 19:53:53.083352 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:53.083307    2576 patch_prober.go:28] interesting pod/e2e-api-b-3adaab-openshift-default-659664b78-l8skx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 19:53:53.083571 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:53.083370    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 19:53:54.083602 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:54.083526    2576 patch_prober.go:28] interesting pod/e2e-api-b-3adaab-openshift-default-659664b78-l8skx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 29 19:53:54.084011 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:54.083619    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 29 19:53:55.087628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:55.087593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:55.088003 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:55.087960    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:53:55.088628 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:53:55.088611    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:54:00.446919 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:00.446831    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:06.920779 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:06.920746    2576 scope.go:117] "RemoveContainer" containerID="11798fe2dbaea99b03e37e447cad2a8d607db3c8f977dad4c37a0e7e2e495482"
Jul 29 19:54:14.303081 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:14.303041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:18.814333 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:18.814299    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"]
Jul 29 19:54:18.814848 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:18.814611    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5" podUID="4789c782-010f-4b2d-a963-18f1d4b3d09c" containerName="maas-api" containerID="cri-o://d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67" gracePeriod=30
Jul 29 19:54:18.841257 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:18.841225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:18.942339 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:18.942297    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:19.009669 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.009630    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:19.075884 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.075812    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:54:19.203395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.203354    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbq9f\" (UniqueName: \"kubernetes.io/projected/4789c782-010f-4b2d-a963-18f1d4b3d09c-kube-api-access-tbq9f\") pod \"4789c782-010f-4b2d-a963-18f1d4b3d09c\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") "
Jul 29 19:54:19.203613 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.203432    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4789c782-010f-4b2d-a963-18f1d4b3d09c-openshift-service-ca\") pod \"4789c782-010f-4b2d-a963-18f1d4b3d09c\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") "
Jul 29 19:54:19.203613 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.203458    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls\") pod \"4789c782-010f-4b2d-a963-18f1d4b3d09c\" (UID: \"4789c782-010f-4b2d-a963-18f1d4b3d09c\") "
Jul 29 19:54:19.203803 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.203776    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4789c782-010f-4b2d-a963-18f1d4b3d09c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4789c782-010f-4b2d-a963-18f1d4b3d09c" (UID: "4789c782-010f-4b2d-a963-18f1d4b3d09c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:19.205506 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.205481    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4789c782-010f-4b2d-a963-18f1d4b3d09c" (UID: "4789c782-010f-4b2d-a963-18f1d4b3d09c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:54:19.205641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.205619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4789c782-010f-4b2d-a963-18f1d4b3d09c-kube-api-access-tbq9f" (OuterVolumeSpecName: "kube-api-access-tbq9f") pod "4789c782-010f-4b2d-a963-18f1d4b3d09c" (UID: "4789c782-010f-4b2d-a963-18f1d4b3d09c"). InnerVolumeSpecName "kube-api-access-tbq9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:19.304340 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.304303    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbq9f\" (UniqueName: \"kubernetes.io/projected/4789c782-010f-4b2d-a963-18f1d4b3d09c-kube-api-access-tbq9f\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:19.304340 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.304335    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4789c782-010f-4b2d-a963-18f1d4b3d09c-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:19.304340 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.304347    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4789c782-010f-4b2d-a963-18f1d4b3d09c-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:19.372293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.372208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:19.547522 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.547483    2576 generic.go:356] "Generic (PLEG): container finished" podID="4789c782-010f-4b2d-a963-18f1d4b3d09c" containerID="d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67" exitCode=0
Jul 29 19:54:19.547710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.547533    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"
Jul 29 19:54:19.547710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.547575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5" event={"ID":"4789c782-010f-4b2d-a963-18f1d4b3d09c","Type":"ContainerDied","Data":"d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67"}
Jul 29 19:54:19.547710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.547637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5" event={"ID":"4789c782-010f-4b2d-a963-18f1d4b3d09c","Type":"ContainerDied","Data":"5af5b28f45591a249bde17d9dc0fd68b4ab44520e543ee3583757f1e2e8587f8"}
Jul 29 19:54:19.547710 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.547660    2576 scope.go:117] "RemoveContainer" containerID="d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67"
Jul 29 19:54:19.563404 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.563383    2576 scope.go:117] "RemoveContainer" containerID="d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67"
Jul 29 19:54:19.563742 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:54:19.563721    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67\": container with ID starting with d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67 not found: ID does not exist" containerID="d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67"
Jul 29 19:54:19.563837 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.563752    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67"} err="failed to get container status \"d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67\": rpc error: code = NotFound desc = could not find container \"d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67\": container with ID starting with d6e9d7e999b73eff2e8f7d9836e11861eb47fe50ed1ba85b865693ddf06a9e67 not found: ID does not exist"
Jul 29 19:54:19.583727 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.583692    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"]
Jul 29 19:54:19.587304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:19.587278    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a62265-75448f5d57-48nc5"]
Jul 29 19:54:20.715040 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:20.715007    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4789c782-010f-4b2d-a963-18f1d4b3d09c" path="/var/lib/kubelet/pods/4789c782-010f-4b2d-a963-18f1d4b3d09c/volumes"
Jul 29 19:54:25.154697 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:25.154664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:25.229377 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:25.229320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:25.415265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:25.415176    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"]
Jul 29 19:54:25.415461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:25.415431    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy" containerID="cri-o://502b0055d170639c2799ceee6a8c71f33bdd521b23364d73b43e082cb315215e" gracePeriod=30
Jul 29 19:54:25.444642 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:25.444588    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:25.658085 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:25.658049    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:30.606824 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.606793    2576 generic.go:356] "Generic (PLEG): container finished" podID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerID="502b0055d170639c2799ceee6a8c71f33bdd521b23364d73b43e082cb315215e" exitCode=0
Jul 29 19:54:30.607196 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.606861    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" event={"ID":"c247ff55-c4a1-4536-a81c-cd0a51dc5369","Type":"ContainerDied","Data":"502b0055d170639c2799ceee6a8c71f33bdd521b23364d73b43e082cb315215e"}
Jul 29 19:54:30.607196 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.606923    2576 scope.go:117] "RemoveContainer" containerID="22ef7a234d13f072096186a936610e90c9f8337dff0652130896251207f16106"
Jul 29 19:54:30.669685 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.669660    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:54:30.818199 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818149    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-socket\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818253    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-podinfo\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818273    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-credential-socket\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8r7m\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-kube-api-access-d8r7m\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818303    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-token\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818421 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-certs\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818720 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818438    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-data\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818720 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818489    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istiod-ca-cert\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818720 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:30.818720 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818520    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-envoy\") pod \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\" (UID: \"c247ff55-c4a1-4536-a81c-cd0a51dc5369\") "
Jul 29 19:54:30.818720 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818652    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:30.818720 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818668    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:30.818989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818881    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.818989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818901    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.818989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818916    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.818989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.818932    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:30.819656 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.819620    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-data" (OuterVolumeSpecName: "istio-data") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:30.820806 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.820781    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-kube-api-access-d8r7m" (OuterVolumeSpecName: "kube-api-access-d8r7m") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "kube-api-access-d8r7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:30.820917 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.820781    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-token" (OuterVolumeSpecName: "istio-token") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:30.821009 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.820993    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:30.821084 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.821068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c247ff55-c4a1-4536-a81c-cd0a51dc5369" (UID: "c247ff55-c4a1-4536-a81c-cd0a51dc5369"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:54:30.919785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.919728    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.919785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.919778    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8r7m\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-kube-api-access-d8r7m\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.919785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.919789    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.919785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.919798    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.919785 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.919807    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:30.920111 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:30.919814    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c247ff55-c4a1-4536-a81c-cd0a51dc5369-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:31.613842 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:31.613810    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"
Jul 29 19:54:31.614320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:31.613807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c" event={"ID":"c247ff55-c4a1-4536-a81c-cd0a51dc5369","Type":"ContainerDied","Data":"0a416f675115b8ebc6c5cd855fa7e9b4d40ad9e498e4a8930c9282c37366e0dd"}
Jul 29 19:54:31.614320 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:31.613961    2576 scope.go:117] "RemoveContainer" containerID="502b0055d170639c2799ceee6a8c71f33bdd521b23364d73b43e082cb315215e"
Jul 29 19:54:31.640191 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:31.640077    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"]
Jul 29 19:54:31.642947 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:31.642919    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a62265-openshift-default-746d8ccd96-8d72c"]
Jul 29 19:54:32.714992 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:32.714955    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" path="/var/lib/kubelet/pods/c247ff55-c4a1-4536-a81c-cd0a51dc5369/volumes"
Jul 29 19:54:41.235427 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.235385    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"]
Jul 29 19:54:41.235930 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.235700    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz" podUID="28003896-4d3c-4d1d-924d-af1c73d68ba5" containerName="maas-api" containerID="cri-o://c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c" gracePeriod=30
Jul 29 19:54:41.261682 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.261651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:41.330754 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.330720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:41.398269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.398210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:41.494447 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.494383    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:54:41.510707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.510676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28003896-4d3c-4d1d-924d-af1c73d68ba5-openshift-service-ca\") pod \"28003896-4d3c-4d1d-924d-af1c73d68ba5\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") "
Jul 29 19:54:41.510707 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.510710    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9wh2\" (UniqueName: \"kubernetes.io/projected/28003896-4d3c-4d1d-924d-af1c73d68ba5-kube-api-access-f9wh2\") pod \"28003896-4d3c-4d1d-924d-af1c73d68ba5\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") "
Jul 29 19:54:41.510927 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.510841    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls\") pod \"28003896-4d3c-4d1d-924d-af1c73d68ba5\" (UID: \"28003896-4d3c-4d1d-924d-af1c73d68ba5\") "
Jul 29 19:54:41.511068 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.511044    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28003896-4d3c-4d1d-924d-af1c73d68ba5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28003896-4d3c-4d1d-924d-af1c73d68ba5" (UID: "28003896-4d3c-4d1d-924d-af1c73d68ba5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:41.512988 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.512964    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28003896-4d3c-4d1d-924d-af1c73d68ba5" (UID: "28003896-4d3c-4d1d-924d-af1c73d68ba5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:54:41.513127 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.513026    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28003896-4d3c-4d1d-924d-af1c73d68ba5-kube-api-access-f9wh2" (OuterVolumeSpecName: "kube-api-access-f9wh2") pod "28003896-4d3c-4d1d-924d-af1c73d68ba5" (UID: "28003896-4d3c-4d1d-924d-af1c73d68ba5"). InnerVolumeSpecName "kube-api-access-f9wh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:41.546061 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.546025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:41.612171 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.612128    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28003896-4d3c-4d1d-924d-af1c73d68ba5-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:41.612171 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.612169    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9wh2\" (UniqueName: \"kubernetes.io/projected/28003896-4d3c-4d1d-924d-af1c73d68ba5-kube-api-access-f9wh2\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:41.612347 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.612189    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28003896-4d3c-4d1d-924d-af1c73d68ba5-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:41.670539 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.670505    2576 generic.go:356] "Generic (PLEG): container finished" podID="28003896-4d3c-4d1d-924d-af1c73d68ba5" containerID="c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c" exitCode=0
Jul 29 19:54:41.670752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.670581    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"
Jul 29 19:54:41.670752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.670585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz" event={"ID":"28003896-4d3c-4d1d-924d-af1c73d68ba5","Type":"ContainerDied","Data":"c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c"}
Jul 29 19:54:41.670752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.670704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz" event={"ID":"28003896-4d3c-4d1d-924d-af1c73d68ba5","Type":"ContainerDied","Data":"c831ae8f2fa44bf5d213ef5ec6f012aee15be11428b14ff4454716a01f4bf645"}
Jul 29 19:54:41.670752 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.670737    2576 scope.go:117] "RemoveContainer" containerID="c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c"
Jul 29 19:54:41.680965 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.680944    2576 scope.go:117] "RemoveContainer" containerID="c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c"
Jul 29 19:54:41.681212 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:54:41.681189    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c\": container with ID starting with c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c not found: ID does not exist" containerID="c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c"
Jul 29 19:54:41.681261 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.681221    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c"} err="failed to get container status \"c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c\": rpc error: code = NotFound desc = could not find container \"c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c\": container with ID starting with c97dc9f4e6598a09a8b5ca09d7a38703971bb09d75afb3e4e812042507781f1c not found: ID does not exist"
Jul 29 19:54:41.693499 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.693467    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"]
Jul 29 19:54:41.697485 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.697463    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3adaab-5768bcdb7b-2ktvz"]
Jul 29 19:54:41.839153 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:41.839120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:42.715291 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:42.715259    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28003896-4d3c-4d1d-924d-af1c73d68ba5" path="/var/lib/kubelet/pods/28003896-4d3c-4d1d-924d-af1c73d68ba5/volumes"
Jul 29 19:54:47.925338 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:47.925300    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:48.026199 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.026164    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:48.169741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.169707    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"]
Jul 29 19:54:48.169935 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.169910    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy" containerID="cri-o://e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e" gracePeriod=30
Jul 29 19:54:48.193685 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.193600    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:48.400836 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.400802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:48.723807 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.723774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:48.991098 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991015    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"]
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991410    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28003896-4d3c-4d1d-924d-af1c73d68ba5" containerName="maas-api"
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991430    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28003896-4d3c-4d1d-924d-af1c73d68ba5" containerName="maas-api"
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991448    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy"
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991458    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy"
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991470    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy"
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991479    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy"
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991489    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4789c782-010f-4b2d-a963-18f1d4b3d09c" containerName="maas-api"
Jul 29 19:54:48.991520 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991495    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4789c782-010f-4b2d-a963-18f1d4b3d09c" containerName="maas-api"
Jul 29 19:54:48.991892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991580    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy"
Jul 29 19:54:48.991892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991590    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c247ff55-c4a1-4536-a81c-cd0a51dc5369" containerName="istio-proxy"
Jul 29 19:54:48.991892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991598    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28003896-4d3c-4d1d-924d-af1c73d68ba5" containerName="maas-api"
Jul 29 19:54:48.991892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.991604    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4789c782-010f-4b2d-a963-18f1d4b3d09c" containerName="maas-api"
Jul 29 19:54:48.996138 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.996115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:48.998278 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:48.998257    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9a3702-openshift-default-dockercfg-njgjc\""
Jul 29 19:54:49.007342 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.007314    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"]
Jul 29 19:54:49.022040 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.022002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:49.074813 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.074775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/263bbd28-08e2-4f72-b895-ed4b12288830-istiod-ca-cert\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.074828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2t9m\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-kube-api-access-c2t9m\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.074907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-certs\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.074976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-istio-token\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075039 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.075013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-credential-socket\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.075050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-socket\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.075100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-data\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.075122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/263bbd28-08e2-4f72-b895-ed4b12288830-istio-podinfo\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.075215 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.075183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-envoy\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.175736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.175694    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-envoy\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.175955 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.175760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/263bbd28-08e2-4f72-b895-ed4b12288830-istiod-ca-cert\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.175955 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.175791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2t9m\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-kube-api-access-c2t9m\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.175955 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.175814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-certs\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.175955 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.175856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-istio-token\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-credential-socket\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-socket\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-data\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/263bbd28-08e2-4f72-b895-ed4b12288830-istio-podinfo\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176200 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-certs\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176395    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-credential-socket\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176491 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-data\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176590 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-socket\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.176641 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.176621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/263bbd28-08e2-4f72-b895-ed4b12288830-istiod-ca-cert\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.178044 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.178022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-envoy\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.178609 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.178589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/263bbd28-08e2-4f72-b895-ed4b12288830-istio-podinfo\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.183661 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.183636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2t9m\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-kube-api-access-c2t9m\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.183771 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.183667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-istio-token\") pod \"e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") " pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.307687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.307645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:49.310391 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.310228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:49.464318 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.464292    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"]
Jul 29 19:54:49.466520 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:54:49.466486    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263bbd28_08e2_4f72_b895_ed4b12288830.slice/crio-63f5dba3ce9b0c28558b98544707efd0bfc6f1d21b447860864060bf01bd0f30 WatchSource:0}: Error finding container 63f5dba3ce9b0c28558b98544707efd0bfc6f1d21b447860864060bf01bd0f30: Status 404 returned error can't find the container with id 63f5dba3ce9b0c28558b98544707efd0bfc6f1d21b447860864060bf01bd0f30
Jul 29 19:54:49.468763 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.468732    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:49.468838 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.468802    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:49.468838 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.468829    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:49.716209 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.716110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" event={"ID":"263bbd28-08e2-4f72-b895-ed4b12288830","Type":"ContainerStarted","Data":"58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2"}
Jul 29 19:54:49.716209 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.716168    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" event={"ID":"263bbd28-08e2-4f72-b895-ed4b12288830","Type":"ContainerStarted","Data":"63f5dba3ce9b0c28558b98544707efd0bfc6f1d21b447860864060bf01bd0f30"}
Jul 29 19:54:49.740635 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:49.740582    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" podStartSLOduration=1.740563268 podStartE2EDuration="1.740563268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:49.739768489 +0000 UTC m=+2383.635585760" watchObservedRunningTime="2026-07-29 19:54:49.740563268 +0000 UTC m=+2383.636380540"
Jul 29 19:54:50.309836 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:50.309799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:50.314619 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:50.314579    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:50.721904 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:50.721815    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:50.722948 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:50.722927    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:54:51.632852 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.632814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:51.711243 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.711200    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"]
Jul 29 19:54:51.715429 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.715400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.716370 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.716340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:51.717600 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.717578    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-9a3702-serving-cert\""
Jul 29 19:54:51.727087 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.727059    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"]
Jul 29 19:54:51.785069 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.785031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:51.801342 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.801306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdlv9\" (UniqueName: \"kubernetes.io/projected/c052fc24-dbf6-4833-aa0f-609226986e7a-kube-api-access-qdlv9\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.801556 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.801354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c052fc24-dbf6-4833-aa0f-609226986e7a-maas-api-tls\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.801556 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.801433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c052fc24-dbf6-4833-aa0f-609226986e7a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.902933 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.902827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c052fc24-dbf6-4833-aa0f-609226986e7a-maas-api-tls\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.902933 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.902900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c052fc24-dbf6-4833-aa0f-609226986e7a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.903183 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.902990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdlv9\" (UniqueName: \"kubernetes.io/projected/c052fc24-dbf6-4833-aa0f-609226986e7a-kube-api-access-qdlv9\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.903594 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.903570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c052fc24-dbf6-4833-aa0f-609226986e7a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.905359 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.905339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c052fc24-dbf6-4833-aa0f-609226986e7a-maas-api-tls\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.916724 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.916695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdlv9\" (UniqueName: \"kubernetes.io/projected/c052fc24-dbf6-4833-aa0f-609226986e7a-kube-api-access-qdlv9\") pod \"maas-api-e2e-shared-a-9a3702-589df88866-hnv6l\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:51.976354 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:51.976321    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:52.028243 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.028205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:52.169213 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.169187    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"]
Jul 29 19:54:52.171180 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:54:52.171140    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc052fc24_dbf6_4833_aa0f_609226986e7a.slice/crio-b1d6e800c1a4c61d276f985b5da3cdf20c037bb0f0c62e4dc608f994f567f20a WatchSource:0}: Error finding container b1d6e800c1a4c61d276f985b5da3cdf20c037bb0f0c62e4dc608f994f567f20a: Status 404 returned error can't find the container with id b1d6e800c1a4c61d276f985b5da3cdf20c037bb0f0c62e4dc608f994f567f20a
Jul 29 19:54:52.411058 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.411024    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:52.505228 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.505193    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:52.737780 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.737743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l" event={"ID":"c052fc24-dbf6-4833-aa0f-609226986e7a","Type":"ContainerStarted","Data":"deb99203e9110602c2a5c258c9daca539fcba05cb71376acd160149dda26dacf"}
Jul 29 19:54:52.738222 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.737805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l" event={"ID":"c052fc24-dbf6-4833-aa0f-609226986e7a","Type":"ContainerStarted","Data":"b1d6e800c1a4c61d276f985b5da3cdf20c037bb0f0c62e4dc608f994f567f20a"}
Jul 29 19:54:52.738222 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.737997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:54:52.754198 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:52.754135    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l" podStartSLOduration=1.333824466 podStartE2EDuration="1.754114467s" totalImagesPullingTime="420.290001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:52.753303152 +0000 UTC m=+2386.649120420" watchObservedRunningTime="2026-07-29 19:54:52.754114467 +0000 UTC m=+2386.649931737"
Jul 29 19:54:53.435685 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.435614    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:54:53.518629 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518590    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c25cw\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-kube-api-access-c25cw\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.518629 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518641    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-envoy\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.518882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518687    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-certs\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.518882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518712    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-token\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.518882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a095e-4e15-4c03-b668-0410f6bc478c-istiod-ca-cert\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.518882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518800    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-credential-socket\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.518882 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518852    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-data\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.519140 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-socket\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.519140 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.518922    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-podinfo\") pod \"cc7a095e-4e15-4c03-b668-0410f6bc478c\" (UID: \"cc7a095e-4e15-4c03-b668-0410f6bc478c\") "
Jul 29 19:54:53.519140 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.519034    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:53.519304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.519255    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.519304 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.519284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:53.519437 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.519412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:53.519501 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.519475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a095e-4e15-4c03-b668-0410f6bc478c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:54:53.520161 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.520134    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:53.521250 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.521224    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:53.521250 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.521232    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-kube-api-access-c25cw" (OuterVolumeSpecName: "kube-api-access-c25cw") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "kube-api-access-c25cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:53.521441 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.521412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:54:53.521441 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.521426    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc7a095e-4e15-4c03-b668-0410f6bc478c" (UID: "cc7a095e-4e15-4c03-b668-0410f6bc478c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:53.620464 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620429    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.620464 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620460    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.620464 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620470    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.620741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620480    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.620741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620489    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c25cw\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-kube-api-access-c25cw\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.620741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620497    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.620741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620506    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a095e-4e15-4c03-b668-0410f6bc478c-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.620741 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.620513    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a095e-4e15-4c03-b668-0410f6bc478c-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 19:54:53.746606 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.746485    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerID="e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e" exitCode=0
Jul 29 19:54:53.746606 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.746533    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"
Jul 29 19:54:53.746606 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.746585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" event={"ID":"cc7a095e-4e15-4c03-b668-0410f6bc478c","Type":"ContainerDied","Data":"e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e"}
Jul 29 19:54:53.747207 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.746647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx" event={"ID":"cc7a095e-4e15-4c03-b668-0410f6bc478c","Type":"ContainerDied","Data":"f3f406264ff122596ad2ccb741dfc27daac75d6c2de834a097883fd00096513b"}
Jul 29 19:54:53.747207 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.746677    2576 scope.go:117] "RemoveContainer" containerID="e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e"
Jul 29 19:54:53.757067 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.757044    2576 scope.go:117] "RemoveContainer" containerID="d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756"
Jul 29 19:54:53.765809 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.765786    2576 scope.go:117] "RemoveContainer" containerID="e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e"
Jul 29 19:54:53.766127 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:54:53.766103    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e\": container with ID starting with e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e not found: ID does not exist" containerID="e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e"
Jul 29 19:54:53.766192 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.766137    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e"} err="failed to get container status \"e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e\": rpc error: code = NotFound desc = could not find container \"e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e\": container with ID starting with e229cfd9f9bd76e2ba1235eb8bda643e98ce50d168063102e89fe32c9711789e not found: ID does not exist"
Jul 29 19:54:53.766192 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.766157    2576 scope.go:117] "RemoveContainer" containerID="d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756"
Jul 29 19:54:53.766407 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:54:53.766393    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756\": container with ID starting with d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756 not found: ID does not exist" containerID="d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756"
Jul 29 19:54:53.766462 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.766409    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756"} err="failed to get container status \"d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756\": rpc error: code = NotFound desc = could not find container \"d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756\": container with ID starting with d3e7600d264e86e012a9b2999d69edc75d42d7463a24335689aa7e2f7d068756 not found: ID does not exist"
Jul 29 19:54:53.770985 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.770959    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"]
Jul 29 19:54:53.774654 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:53.774627    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3adaab-openshift-default-659664b78-l8skx"]
Jul 29 19:54:54.715888 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:54.715850    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" path="/var/lib/kubelet/pods/cc7a095e-4e15-4c03-b668-0410f6bc478c/volumes"
Jul 29 19:54:58.756781 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:54:58.756745    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 19:55:05.723365 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.723327    2576 patch_prober.go:28] interesting pod/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 29 19:55:05.723835 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.723387    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 29 19:55:05.814287 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.814256    2576 generic.go:356] "Generic (PLEG): container finished" podID="263bbd28-08e2-4f72-b895-ed4b12288830" containerID="58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2" exitCode=0
Jul 29 19:55:05.814463 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.814336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" event={"ID":"263bbd28-08e2-4f72-b895-ed4b12288830","Type":"ContainerDied","Data":"58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2"}
Jul 29 19:55:05.814813 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.814793    2576 scope.go:117] "RemoveContainer" containerID="58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2"
Jul 29 19:55:05.815816 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.815788    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:05.815885 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.815853    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:05.815924 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:05.815884    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:06.822362 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:06.822322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" event={"ID":"263bbd28-08e2-4f72-b895-ed4b12288830","Type":"ContainerStarted","Data":"160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd"}
Jul 29 19:55:07.309578 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:07.309528    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:55:07.309787 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:07.309757    2576 patch_prober.go:28] interesting pod/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 29 19:55:07.309848 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:07.309825    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 29 19:55:08.309910 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:08.309865    2576 patch_prober.go:28] interesting pod/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 29 19:55:08.310403 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:08.309927    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 29 19:55:09.309989 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:09.309948    2576 patch_prober.go:28] interesting pod/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 29 19:55:09.310392 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:09.310022    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 29 19:55:10.309514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:10.309472    2576 patch_prober.go:28] interesting pod/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 29 19:55:10.309736 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:10.309569    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 29 19:55:11.313093 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:11.313059    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:55:11.313607 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:11.313366    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:55:11.314217 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:11.314199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 19:55:16.606383 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:16.606344    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:16.938395 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:16.938291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:17.244114 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.244018    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"]
Jul 29 19:55:17.244454 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.244432    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy"
Jul 29 19:55:17.244454 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.244452    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy"
Jul 29 19:55:17.244454 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.244461    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy"
Jul 29 19:55:17.244734 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.244467    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy"
Jul 29 19:55:17.244734 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.244557    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy"
Jul 29 19:55:17.244734 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.244570    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7a095e-4e15-4c03-b668-0410f6bc478c" containerName="istio-proxy"
Jul 29 19:55:17.247782 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.247760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.250497 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.250474    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-8ef216-openshift-default-dockercfg-97gl7\""
Jul 29 19:55:17.263852 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.263822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"]
Jul 29 19:55:17.268720 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.268691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:17.340496 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md5bc\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-kube-api-access-md5bc\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340689 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-socket\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340689 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-podinfo\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340689 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-data\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340689 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istiod-ca-cert\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340689 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-token\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-certs\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-envoy\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.340892 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.340756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-credential-socket\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.374286 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.374252    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:17.441998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.441917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md5bc\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-kube-api-access-md5bc\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.441998 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-socket\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-podinfo\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-data\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istiod-ca-cert\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-token\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-certs\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-envoy\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442265 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-credential-socket\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442694 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442603    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-data\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442694 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-certs\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.442805 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-socket\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.443005 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.442833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-credential-socket\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.443081 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.443007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istiod-ca-cert\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.445186 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.445153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-envoy\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.445371 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.445349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-podinfo\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.449484 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.449451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-token\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.449773 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.449755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md5bc\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-kube-api-access-md5bc\") pod \"e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") " pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.558019 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.557978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:17.699761 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.699734    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"]
Jul 29 19:55:17.701184 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:55:17.701154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e229bc_d651_4ce3_9a29_30ab7ef94f95.slice/crio-a6b667a0746d7bfd3761e6bebfd42bcd06e81893b48a074260b0fa3cbba5c255 WatchSource:0}: Error finding container a6b667a0746d7bfd3761e6bebfd42bcd06e81893b48a074260b0fa3cbba5c255: Status 404 returned error can't find the container with id a6b667a0746d7bfd3761e6bebfd42bcd06e81893b48a074260b0fa3cbba5c255
Jul 29 19:55:17.703574 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.703522    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:17.703642 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.703611    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:17.703687 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.703639    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:17.886293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.886202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" event={"ID":"18e229bc-d651-4ce3-9a29-30ab7ef94f95","Type":"ContainerStarted","Data":"2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548"}
Jul 29 19:55:17.886293 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.886270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" event={"ID":"18e229bc-d651-4ce3-9a29-30ab7ef94f95","Type":"ContainerStarted","Data":"a6b667a0746d7bfd3761e6bebfd42bcd06e81893b48a074260b0fa3cbba5c255"}
Jul 29 19:55:17.906263 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:17.906208    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podStartSLOduration=0.906189992 podStartE2EDuration="906.189992ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:55:17.904613837 +0000 UTC m=+2411.800431107" watchObservedRunningTime="2026-07-29 19:55:17.906189992 +0000 UTC m=+2411.802007262"
Jul 29 19:55:18.558302 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:18.558265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:18.563019 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:18.562992    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:18.891904 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:18.891799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:18.893000 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:18.892975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:19.865952 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:19.865915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:19.949947 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:19.949908    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"]
Jul 29 19:55:19.951955 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:19.951920    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:19.954314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:19.954293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:19.956426 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:19.956406    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8ef216-serving-cert\""
Jul 29 19:55:19.964924 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:19.964890    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"]
Jul 29 19:55:20.016031 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.016000    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:20.067775 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.067738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38999cd4-0508-43df-a6c9-cf9823b7d09b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.068290 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.068264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx5mw\" (UniqueName: \"kubernetes.io/projected/38999cd4-0508-43df-a6c9-cf9823b7d09b-kube-api-access-tx5mw\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.068854 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.068833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.170225 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.170128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.170225 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.170177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38999cd4-0508-43df-a6c9-cf9823b7d09b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.170461 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:55:20.170280    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-serving-cert: secret "maas-api-e2e-shared-b-8ef216-serving-cert" not found
Jul 29 19:55:20.170461 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.170272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5mw\" (UniqueName: \"kubernetes.io/projected/38999cd4-0508-43df-a6c9-cf9823b7d09b-kube-api-access-tx5mw\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.170461 ip-10-0-131-202 kubenswrapper[2576]: E0729 19:55:20.170345    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls podName:38999cd4-0508-43df-a6c9-cf9823b7d09b nodeName:}" failed. No retries permitted until 2026-07-29 19:55:20.67032646 +0000 UTC m=+2414.566143706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls") pod "maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj" (UID: "38999cd4-0508-43df-a6c9-cf9823b7d09b") : secret "maas-api-e2e-shared-b-8ef216-serving-cert" not found
Jul 29 19:55:20.170829 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.170807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38999cd4-0508-43df-a6c9-cf9823b7d09b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.179183 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.179148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx5mw\" (UniqueName: \"kubernetes.io/projected/38999cd4-0508-43df-a6c9-cf9823b7d09b-kube-api-access-tx5mw\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.436314 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.436226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:20.546669 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.546629    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:20.643795 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.643759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:20.676063 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.676003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.678597 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.678571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls\") pod \"maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:20.866229 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:20.866185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:21.008242 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:21.008211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"]
Jul 29 19:55:21.009810 ip-10-0-131-202 kubenswrapper[2576]: W0729 19:55:21.009782    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38999cd4_0508_43df_a6c9_cf9823b7d09b.slice/crio-8c7b4cd77a1dc97e09101d4640a54091bb21749f2b6f358117aa6a2e24fbf553 WatchSource:0}: Error finding container 8c7b4cd77a1dc97e09101d4640a54091bb21749f2b6f358117aa6a2e24fbf553: Status 404 returned error can't find the container with id 8c7b4cd77a1dc97e09101d4640a54091bb21749f2b6f358117aa6a2e24fbf553
Jul 29 19:55:21.908050 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:21.907952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj" event={"ID":"38999cd4-0508-43df-a6c9-cf9823b7d09b","Type":"ContainerStarted","Data":"124852464ebecd1dace759430f71aa0d1e3028294f00dd80ab7e52983bbc72be"}
Jul 29 19:55:21.908050 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:21.908023    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:21.908050 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:21.908048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj" event={"ID":"38999cd4-0508-43df-a6c9-cf9823b7d09b","Type":"ContainerStarted","Data":"8c7b4cd77a1dc97e09101d4640a54091bb21749f2b6f358117aa6a2e24fbf553"}
Jul 29 19:55:21.925617 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:21.925554    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj" podStartSLOduration=2.411866118 podStartE2EDuration="2.925525073s" totalImagesPullingTime="513.658955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:55:21.923147285 +0000 UTC m=+2415.818964555" watchObservedRunningTime="2026-07-29 19:55:21.925525073 +0000 UTC m=+2415.821342365"
Jul 29 19:55:27.921584 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:27.921490    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 19:55:34.768269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.768123    2576 patch_prober.go:28] interesting pod/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:35878->10.133.0.72:15021: read: connection reset by peer" start-of-body=
Jul 29 19:55:34.768269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.768208    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:35878->10.133.0.72:15021: read: connection reset by peer"
Jul 29 19:55:34.987801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.987697    2576 generic.go:356] "Generic (PLEG): container finished" podID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerID="2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548" exitCode=0
Jul 29 19:55:34.987801 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.987751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" event={"ID":"18e229bc-d651-4ce3-9a29-30ab7ef94f95","Type":"ContainerDied","Data":"2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548"}
Jul 29 19:55:34.988210 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.988190    2576 scope.go:117] "RemoveContainer" containerID="2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548"
Jul 29 19:55:34.989269 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.989241    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:34.989344 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.989331    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:34.989384 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:34.989375    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:55:35.995614 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:35.995578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" event={"ID":"18e229bc-d651-4ce3-9a29-30ab7ef94f95","Type":"ContainerStarted","Data":"310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92"}
Jul 29 19:55:36.558562 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:36.558508    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:36.558768 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:36.558694    2576 patch_prober.go:28] interesting pod/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 19:55:36.558820 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:36.558761    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 19:55:37.559414 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:37.559374    2576 patch_prober.go:28] interesting pod/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 19:55:37.559867 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:37.559431    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 19:55:38.559129 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:38.559088    2576 patch_prober.go:28] interesting pod/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 19:55:38.559307 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:38.559145    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 19:55:39.559100 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:39.559051    2576 patch_prober.go:28] interesting pod/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 19:55:39.559514 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:39.559120    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 19:55:40.559142 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:40.559099    2576 patch_prober.go:28] interesting pod/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 29 19:55:40.559671 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:40.559163    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 29 19:55:41.561854 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:41.561822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:41.562306 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:41.562145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:41.562869 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:41.562854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 19:55:44.901076 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:44.901031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:55.941558 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:55:55.941470    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:12.193768 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:56:12.193733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:15.611809 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:56:15.611773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:24.661283 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:56:24.661249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:33.437099 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:58:33.437003    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 19:59:07.001372 ip-10-0-131-202 kubenswrapper[2576]: I0729 19:59:07.001340    2576 scope.go:117] "RemoveContainer" containerID="76a37743973690670b7397a84082d729ac7e532ade38da17bfec185e46a104db"
Jul 29 20:00:00.138286 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.138197    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475"]
Jul 29 20:00:00.141858 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.141834    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"]
Jul 29 20:00:00.141991 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.141946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475"
Jul 29 20:00:00.144755 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.144735    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 20:00:00.145115 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.145097    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"]
Jul 29 20:00:00.145225 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.145210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"
Jul 29 20:00:00.148467 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.148448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"
Jul 29 20:00:00.152109 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.152093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475"
Jul 29 20:00:00.161160 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.161140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"
Jul 29 20:00:00.164118 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.164055    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475"]
Jul 29 20:00:00.172146 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.172113    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"]
Jul 29 20:00:00.172258 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.172185    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"]
Jul 29 20:00:00.197140 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.197111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"
Jul 29 20:00:00.319513 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.319472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475"]
Jul 29 20:00:00.320579 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:00:00.320530    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf092a80a_5ab4_4821_a250_611ca0d60fdc.slice/crio-b05ea4adf78e69313dac2ce2cf771216b3d808a1da75aaa38706e495319296c8 WatchSource:0}: Error finding container b05ea4adf78e69313dac2ce2cf771216b3d808a1da75aaa38706e495319296c8: Status 404 returned error can't find the container with id b05ea4adf78e69313dac2ce2cf771216b3d808a1da75aaa38706e495319296c8
Jul 29 20:00:00.353012 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.352985    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"]
Jul 29 20:00:00.357039 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:00:00.357007    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdacfade_e299_4456_aa5d_a52c4938a79d.slice/crio-7b62dde3bd79024431957d5d97b3a6a67503a885328028ef7dbfe6f9b1c56e43 WatchSource:0}: Error finding container 7b62dde3bd79024431957d5d97b3a6a67503a885328028ef7dbfe6f9b1c56e43: Status 404 returned error can't find the container with id 7b62dde3bd79024431957d5d97b3a6a67503a885328028ef7dbfe6f9b1c56e43
Jul 29 20:00:00.383297 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:00:00.383249    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95d4f14_cfe1_49f0_ba21_7628904d06c1.slice/crio-9c103ef764f7efd87b3179a102f98ae8bf92d3ae5e7540f7a4a9ab3e9bf76e01 WatchSource:0}: Error finding container 9c103ef764f7efd87b3179a102f98ae8bf92d3ae5e7540f7a4a9ab3e9bf76e01: Status 404 returned error can't find the container with id 9c103ef764f7efd87b3179a102f98ae8bf92d3ae5e7540f7a4a9ab3e9bf76e01
Jul 29 20:00:00.383589 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.383566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"]
Jul 29 20:00:00.383867 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.383835    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck" event={"ID":"fdacfade-e299-4456-aa5d-a52c4938a79d","Type":"ContainerStarted","Data":"7b62dde3bd79024431957d5d97b3a6a67503a885328028ef7dbfe6f9b1c56e43"}
Jul 29 20:00:00.385277 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:00.385245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475" event={"ID":"f092a80a-5ab4-4821-a250-611ca0d60fdc","Type":"ContainerStarted","Data":"b05ea4adf78e69313dac2ce2cf771216b3d808a1da75aaa38706e495319296c8"}
Jul 29 20:00:01.393473 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:01.393432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck" event={"ID":"fdacfade-e299-4456-aa5d-a52c4938a79d","Type":"ContainerStarted","Data":"4eb58cf8f02735cb3bc063c985077be8569fe6677031254422a965abcd1bfbb5"}
Jul 29 20:00:01.394894 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:01.394868    2576 generic.go:356] "Generic (PLEG): container finished" podID="f092a80a-5ab4-4821-a250-611ca0d60fdc" containerID="273e9584673bed38489f0fbd30de50e585949b56ba5ed019397cc63929ceab7c" exitCode=0
Jul 29 20:00:01.395022 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:01.394946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475" event={"ID":"f092a80a-5ab4-4821-a250-611ca0d60fdc","Type":"ContainerDied","Data":"273e9584673bed38489f0fbd30de50e585949b56ba5ed019397cc63929ceab7c"}
Jul 29 20:00:01.396334 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:01.396301    2576 generic.go:356] "Generic (PLEG): container finished" podID="b95d4f14-cfe1-49f0-ba21-7628904d06c1" containerID="7ac1914522cce4b653bdeddd5c0c2d0daa816608f6a904a087ce4818c839a680" exitCode=0
Jul 29 20:00:01.396444 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:01.396336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx" event={"ID":"b95d4f14-cfe1-49f0-ba21-7628904d06c1","Type":"ContainerDied","Data":"7ac1914522cce4b653bdeddd5c0c2d0daa816608f6a904a087ce4818c839a680"}
Jul 29 20:00:01.396444 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:01.396389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx" event={"ID":"b95d4f14-cfe1-49f0-ba21-7628904d06c1","Type":"ContainerStarted","Data":"9c103ef764f7efd87b3179a102f98ae8bf92d3ae5e7540f7a4a9ab3e9bf76e01"}
Jul 29 20:00:01.407384 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:01.407326    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck" podStartSLOduration=1.407306106 podStartE2EDuration="1.407306106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:00:01.407274602 +0000 UTC m=+2695.303091873" watchObservedRunningTime="2026-07-29 20:00:01.407306106 +0000 UTC m=+2695.303123376"
Jul 29 20:00:02.403890 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:02.403852    2576 generic.go:356] "Generic (PLEG): container finished" podID="fdacfade-e299-4456-aa5d-a52c4938a79d" containerID="4eb58cf8f02735cb3bc063c985077be8569fe6677031254422a965abcd1bfbb5" exitCode=0
Jul 29 20:00:02.404314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:02.403936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck" event={"ID":"fdacfade-e299-4456-aa5d-a52c4938a79d","Type":"ContainerDied","Data":"4eb58cf8f02735cb3bc063c985077be8569fe6677031254422a965abcd1bfbb5"}
Jul 29 20:00:02.552652 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:02.552629    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"
Jul 29 20:00:02.593120 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:02.593093    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475"
Jul 29 20:00:03.410329 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:03.410290    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475"
Jul 29 20:00:03.410329 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:03.410325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8g475" event={"ID":"f092a80a-5ab4-4821-a250-611ca0d60fdc","Type":"ContainerDied","Data":"b05ea4adf78e69313dac2ce2cf771216b3d808a1da75aaa38706e495319296c8"}
Jul 29 20:00:03.410865 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:03.410375    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b05ea4adf78e69313dac2ce2cf771216b3d808a1da75aaa38706e495319296c8"
Jul 29 20:00:03.411676 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:03.411656    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"
Jul 29 20:00:03.411806 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:03.411696    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx" event={"ID":"b95d4f14-cfe1-49f0-ba21-7628904d06c1","Type":"ContainerDied","Data":"9c103ef764f7efd87b3179a102f98ae8bf92d3ae5e7540f7a4a9ab3e9bf76e01"}
Jul 29 20:00:03.411806 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:03.411730    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c103ef764f7efd87b3179a102f98ae8bf92d3ae5e7540f7a4a9ab3e9bf76e01"
Jul 29 20:00:03.547332 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:03.547308    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"
Jul 29 20:00:04.421836 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:04.421806    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"
Jul 29 20:00:04.421836 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:04.421815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck" event={"ID":"fdacfade-e299-4456-aa5d-a52c4938a79d","Type":"ContainerDied","Data":"7b62dde3bd79024431957d5d97b3a6a67503a885328028ef7dbfe6f9b1c56e43"}
Jul 29 20:00:04.422285 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:04.421865    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b62dde3bd79024431957d5d97b3a6a67503a885328028ef7dbfe6f9b1c56e43"
Jul 29 20:00:50.265936 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:50.265903    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:00:51.333996 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:00:51.333967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:01:01.525850 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.525815    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"]
Jul 29 20:01:01.526316 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526194    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdacfade-e299-4456-aa5d-a52c4938a79d" containerName="cleanup"
Jul 29 20:01:01.526316 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526210    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdacfade-e299-4456-aa5d-a52c4938a79d" containerName="cleanup"
Jul 29 20:01:01.526316 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526221    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f092a80a-5ab4-4821-a250-611ca0d60fdc" containerName="cleanup"
Jul 29 20:01:01.526316 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526227    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f092a80a-5ab4-4821-a250-611ca0d60fdc" containerName="cleanup"
Jul 29 20:01:01.526316 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526235    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b95d4f14-cfe1-49f0-ba21-7628904d06c1" containerName="cleanup"
Jul 29 20:01:01.526316 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526241    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b95d4f14-cfe1-49f0-ba21-7628904d06c1" containerName="cleanup"
Jul 29 20:01:01.526316 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526313    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdacfade-e299-4456-aa5d-a52c4938a79d" containerName="cleanup"
Jul 29 20:01:01.526579 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526323    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f092a80a-5ab4-4821-a250-611ca0d60fdc" containerName="cleanup"
Jul 29 20:01:01.526579 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.526330    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b95d4f14-cfe1-49f0-ba21-7628904d06c1" containerName="cleanup"
Jul 29 20:01:01.530166 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.530145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.535625 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.535593    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"default-dockercfg-n8trl\""
Jul 29 20:01:01.536082 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.536063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"kube-root-ca.crt\""
Jul 29 20:01:01.536164 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.536152    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"sub-test-model-9a3702-kserve-self-signed-certs\""
Jul 29 20:01:01.536396 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.536381    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9a3702\"/\"openshift-service-ca.crt\""
Jul 29 20:01:01.555072 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.555034    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"]
Jul 29 20:01:01.577402 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.577350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:01:01.629969 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.629926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-model-cache\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.629969 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.629974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-home\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.630211 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.629995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ba2b3c-10d4-4382-8208-914b258ada0e-tls-certs\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.630211 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.630030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-tmp-dir\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.630211 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.630080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwvmj\" (UniqueName: \"kubernetes.io/projected/b7ba2b3c-10d4-4382-8208-914b258ada0e-kube-api-access-lwvmj\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.630211 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.630107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-dshm\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.731401 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.731351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwvmj\" (UniqueName: \"kubernetes.io/projected/b7ba2b3c-10d4-4382-8208-914b258ada0e-kube-api-access-lwvmj\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.731676 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.731438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-dshm\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.731676 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.731472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-model-cache\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.731676 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.731529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-home\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.731676 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.731619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ba2b3c-10d4-4382-8208-914b258ada0e-tls-certs\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.731676 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.731645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-tmp-dir\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.732071 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.732049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-tmp-dir\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.732239 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.732211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-home\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.732478 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.732452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-model-cache\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.735272 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.735247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-dshm\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.735615 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.735485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ba2b3c-10d4-4382-8208-914b258ada0e-tls-certs\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.740597 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.740568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwvmj\" (UniqueName: \"kubernetes.io/projected/b7ba2b3c-10d4-4382-8208-914b258ada0e-kube-api-access-lwvmj\") pod \"sub-test-model-9a3702-kserve-67f946699-t9mjr\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") " pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.840025 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.839924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:01.974937 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:01.974906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"]
Jul 29 20:01:01.976224 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:01:01.976196    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7ba2b3c_10d4_4382_8208_914b258ada0e.slice/crio-18f77e2cf1805a151e84053aec274b33c21ca032cc359c5f0a38e00fb6608412 WatchSource:0}: Error finding container 18f77e2cf1805a151e84053aec274b33c21ca032cc359c5f0a38e00fb6608412: Status 404 returned error can't find the container with id 18f77e2cf1805a151e84053aec274b33c21ca032cc359c5f0a38e00fb6608412
Jul 29 20:01:02.734441 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:02.734398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr" event={"ID":"b7ba2b3c-10d4-4382-8208-914b258ada0e","Type":"ContainerStarted","Data":"485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b"}
Jul 29 20:01:02.734953 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:02.734451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr" event={"ID":"b7ba2b3c-10d4-4382-8208-914b258ada0e","Type":"ContainerStarted","Data":"18f77e2cf1805a151e84053aec274b33c21ca032cc359c5f0a38e00fb6608412"}
Jul 29 20:01:02.752456 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:02.752400    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr" podStartSLOduration=1.752383063 podStartE2EDuration="1.752383063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:01:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:01:02.750089955 +0000 UTC m=+2756.645907224" watchObservedRunningTime="2026-07-29 20:01:02.752383063 +0000 UTC m=+2756.648200331"
Jul 29 20:01:11.840643 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:11.840584    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:11.841120 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:11.840665    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:11.853260 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:11.853235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:12.799960 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:12.799931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:01:31.463889 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:31.463810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:01:35.231829 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:01:35.231790    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:02:40.221410 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:40.221368    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"]
Jul 29 20:02:40.241522 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:40.241489    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:02:41.328043 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:41.328013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:02:48.961669 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:48.961639    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:02:55.241404 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.241362    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr" podUID="b7ba2b3c-10d4-4382-8208-914b258ada0e" containerName="main" containerID="cri-o://485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b" gracePeriod=45
Jul 29 20:02:55.504142 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.504115    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:02:55.549269 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549230    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-model-cache\") pod \"b7ba2b3c-10d4-4382-8208-914b258ada0e\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") "
Jul 29 20:02:55.549471 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549321    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-tmp-dir\") pod \"b7ba2b3c-10d4-4382-8208-914b258ada0e\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") "
Jul 29 20:02:55.549471 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549351    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ba2b3c-10d4-4382-8208-914b258ada0e-tls-certs\") pod \"b7ba2b3c-10d4-4382-8208-914b258ada0e\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") "
Jul 29 20:02:55.549471 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549377    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-home\") pod \"b7ba2b3c-10d4-4382-8208-914b258ada0e\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") "
Jul 29 20:02:55.549471 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwvmj\" (UniqueName: \"kubernetes.io/projected/b7ba2b3c-10d4-4382-8208-914b258ada0e-kube-api-access-lwvmj\") pod \"b7ba2b3c-10d4-4382-8208-914b258ada0e\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") "
Jul 29 20:02:55.549736 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-dshm\") pod \"b7ba2b3c-10d4-4382-8208-914b258ada0e\" (UID: \"b7ba2b3c-10d4-4382-8208-914b258ada0e\") "
Jul 29 20:02:55.549736 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549579    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b7ba2b3c-10d4-4382-8208-914b258ada0e" (UID: "b7ba2b3c-10d4-4382-8208-914b258ada0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:55.549736 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549664    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b7ba2b3c-10d4-4382-8208-914b258ada0e" (UID: "b7ba2b3c-10d4-4382-8208-914b258ada0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:55.549893 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549833    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-home" (OuterVolumeSpecName: "home") pod "b7ba2b3c-10d4-4382-8208-914b258ada0e" (UID: "b7ba2b3c-10d4-4382-8208-914b258ada0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:55.549893 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549841    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-model-cache\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:02:55.549893 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.549862    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-tmp-dir\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:02:55.551739 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.551713    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7ba2b3c-10d4-4382-8208-914b258ada0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b7ba2b3c-10d4-4382-8208-914b258ada0e" (UID: "b7ba2b3c-10d4-4382-8208-914b258ada0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:02:55.552075 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.552049    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7ba2b3c-10d4-4382-8208-914b258ada0e-kube-api-access-lwvmj" (OuterVolumeSpecName: "kube-api-access-lwvmj") pod "b7ba2b3c-10d4-4382-8208-914b258ada0e" (UID: "b7ba2b3c-10d4-4382-8208-914b258ada0e"). InnerVolumeSpecName "kube-api-access-lwvmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:02:55.552075 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.552048    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-dshm" (OuterVolumeSpecName: "dshm") pod "b7ba2b3c-10d4-4382-8208-914b258ada0e" (UID: "b7ba2b3c-10d4-4382-8208-914b258ada0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:02:55.651301 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.651250    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ba2b3c-10d4-4382-8208-914b258ada0e-tls-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:02:55.651301 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.651295    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-home\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:02:55.651301 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.651305    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwvmj\" (UniqueName: \"kubernetes.io/projected/b7ba2b3c-10d4-4382-8208-914b258ada0e-kube-api-access-lwvmj\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:02:55.651301 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:55.651313    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ba2b3c-10d4-4382-8208-914b258ada0e-dshm\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:02:56.361502 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.361463    2576 generic.go:356] "Generic (PLEG): container finished" podID="b7ba2b3c-10d4-4382-8208-914b258ada0e" containerID="485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b" exitCode=0
Jul 29 20:02:56.361986 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.361511    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"
Jul 29 20:02:56.361986 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.361562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr" event={"ID":"b7ba2b3c-10d4-4382-8208-914b258ada0e","Type":"ContainerDied","Data":"485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b"}
Jul 29 20:02:56.361986 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.361606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr" event={"ID":"b7ba2b3c-10d4-4382-8208-914b258ada0e","Type":"ContainerDied","Data":"18f77e2cf1805a151e84053aec274b33c21ca032cc359c5f0a38e00fb6608412"}
Jul 29 20:02:56.361986 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.361624    2576 scope.go:117] "RemoveContainer" containerID="485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b"
Jul 29 20:02:56.373931 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.373907    2576 scope.go:117] "RemoveContainer" containerID="485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b"
Jul 29 20:02:56.374242 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:02:56.374219    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b\": container with ID starting with 485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b not found: ID does not exist" containerID="485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b"
Jul 29 20:02:56.374366 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.374249    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b"} err="failed to get container status \"485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b\": rpc error: code = NotFound desc = could not find container \"485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b\": container with ID starting with 485c48b1d52b38342ba6de98c60e9e3eaa7bf2966f0bc3dfe0b02d3e2c6c9d0b not found: ID does not exist"
Jul 29 20:02:56.387076 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.387011    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"]
Jul 29 20:02:56.389967 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.389942    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9a3702/sub-test-model-9a3702-kserve-67f946699-t9mjr"]
Jul 29 20:02:56.714806 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:02:56.714726    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7ba2b3c-10d4-4382-8208-914b258ada0e" path="/var/lib/kubelet/pods/b7ba2b3c-10d4-4382-8208-914b258ada0e/volumes"
Jul 29 20:03:45.224999 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.224964    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"]
Jul 29 20:03:45.225531 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.225425    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7ba2b3c-10d4-4382-8208-914b258ada0e" containerName="main"
Jul 29 20:03:45.225531 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.225442    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7ba2b3c-10d4-4382-8208-914b258ada0e" containerName="main"
Jul 29 20:03:45.225531 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.225516    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7ba2b3c-10d4-4382-8208-914b258ada0e" containerName="main"
Jul 29 20:03:45.228600 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.228578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.231827 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.231792    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"default-dockercfg-2zwvh\""
Jul 29 20:03:45.231991 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.231861    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"kube-root-ca.crt\""
Jul 29 20:03:45.231991 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.231868    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"rate-test-model-8ef216-kserve-self-signed-certs\""
Jul 29 20:03:45.231991 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.231887    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8ef216\"/\"openshift-service-ca.crt\""
Jul 29 20:03:45.239626 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.239596    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"]
Jul 29 20:03:45.259751 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.259704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:03:45.295803 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.295761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-dshm\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.295803 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.295799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-model-cache\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.296043 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.295892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce619f3-81f9-4f76-90b1-5127f17af36a-tls-certs\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.296043 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.295921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwm4\" (UniqueName: \"kubernetes.io/projected/5ce619f3-81f9-4f76-90b1-5127f17af36a-kube-api-access-mmwm4\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.296043 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.295946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-home\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.296043 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.295970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-tmp-dir\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.397469 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.397430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-home\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.397469 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.397474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-tmp-dir\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.397759 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.397512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-dshm\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.397759 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.397534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-model-cache\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.397759 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.397598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce619f3-81f9-4f76-90b1-5127f17af36a-tls-certs\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.397759 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.397633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwm4\" (UniqueName: \"kubernetes.io/projected/5ce619f3-81f9-4f76-90b1-5127f17af36a-kube-api-access-mmwm4\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.398028 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.397967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-model-cache\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.398028 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.398013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-home\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.398136 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.398080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-tmp-dir\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.399991 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.399969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-dshm\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.400280 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.400264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce619f3-81f9-4f76-90b1-5127f17af36a-tls-certs\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.405410 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.405384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwm4\" (UniqueName: \"kubernetes.io/projected/5ce619f3-81f9-4f76-90b1-5127f17af36a-kube-api-access-mmwm4\") pod \"rate-test-model-8ef216-kserve-558d4bf9bc-zm22t\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") " pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.538892 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.538847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:45.679945 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:45.679914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"]
Jul 29 20:03:45.681650 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:03:45.681618    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ce619f3_81f9_4f76_90b1_5127f17af36a.slice/crio-343ab86e67ace15762e54896e9038bfb3d19740b89f50aec90d8abcf8f15e997 WatchSource:0}: Error finding container 343ab86e67ace15762e54896e9038bfb3d19740b89f50aec90d8abcf8f15e997: Status 404 returned error can't find the container with id 343ab86e67ace15762e54896e9038bfb3d19740b89f50aec90d8abcf8f15e997
Jul 29 20:03:46.639475 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:46.639439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t" event={"ID":"5ce619f3-81f9-4f76-90b1-5127f17af36a","Type":"ContainerStarted","Data":"6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45"}
Jul 29 20:03:46.639475 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:46.639482    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t" event={"ID":"5ce619f3-81f9-4f76-90b1-5127f17af36a","Type":"ContainerStarted","Data":"343ab86e67ace15762e54896e9038bfb3d19740b89f50aec90d8abcf8f15e997"}
Jul 29 20:03:46.658120 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:46.658061    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t" podStartSLOduration=1.6580464849999998 podStartE2EDuration="1.658046485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:03:46.657125095 +0000 UTC m=+2920.552942366" watchObservedRunningTime="2026-07-29 20:03:46.658046485 +0000 UTC m=+2920.553863810"
Jul 29 20:03:47.267827 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:47.267790    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:03:55.539474 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:55.539430    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:55.539920 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:55.539490    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:55.552512 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:55.552482    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:03:55.700941 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:03:55.700911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:04:56.546483 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:04:56.546394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:04:57.338670 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:04:57.338634    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"]
Jul 29 20:04:57.374501 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:04:57.374466    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:12.358685 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.358616    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t" podUID="5ce619f3-81f9-4f76-90b1-5127f17af36a" containerName="main" containerID="cri-o://6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45" gracePeriod=45
Jul 29 20:05:12.610763 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.610688    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:05:12.778818 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.778776    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-tmp-dir\") pod \"5ce619f3-81f9-4f76-90b1-5127f17af36a\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") "
Jul 29 20:05:12.778818 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.778819    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmwm4\" (UniqueName: \"kubernetes.io/projected/5ce619f3-81f9-4f76-90b1-5127f17af36a-kube-api-access-mmwm4\") pod \"5ce619f3-81f9-4f76-90b1-5127f17af36a\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") "
Jul 29 20:05:12.779026 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.778843    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-home\") pod \"5ce619f3-81f9-4f76-90b1-5127f17af36a\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") "
Jul 29 20:05:12.779026 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.778949    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce619f3-81f9-4f76-90b1-5127f17af36a-tls-certs\") pod \"5ce619f3-81f9-4f76-90b1-5127f17af36a\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") "
Jul 29 20:05:12.779026 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.778972    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-dshm\") pod \"5ce619f3-81f9-4f76-90b1-5127f17af36a\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") "
Jul 29 20:05:12.779172 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.779031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-model-cache\") pod \"5ce619f3-81f9-4f76-90b1-5127f17af36a\" (UID: \"5ce619f3-81f9-4f76-90b1-5127f17af36a\") "
Jul 29 20:05:12.779172 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.779132    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ce619f3-81f9-4f76-90b1-5127f17af36a" (UID: "5ce619f3-81f9-4f76-90b1-5127f17af36a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:12.779172 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.779144    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-home" (OuterVolumeSpecName: "home") pod "5ce619f3-81f9-4f76-90b1-5127f17af36a" (UID: "5ce619f3-81f9-4f76-90b1-5127f17af36a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:12.779381 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.779359    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-tmp-dir\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:05:12.779440 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.779391    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-home\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:05:12.779440 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.779360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ce619f3-81f9-4f76-90b1-5127f17af36a" (UID: "5ce619f3-81f9-4f76-90b1-5127f17af36a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:12.781257 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.781225    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-dshm" (OuterVolumeSpecName: "dshm") pod "5ce619f3-81f9-4f76-90b1-5127f17af36a" (UID: "5ce619f3-81f9-4f76-90b1-5127f17af36a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:05:12.781371 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.781297    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ce619f3-81f9-4f76-90b1-5127f17af36a-kube-api-access-mmwm4" (OuterVolumeSpecName: "kube-api-access-mmwm4") pod "5ce619f3-81f9-4f76-90b1-5127f17af36a" (UID: "5ce619f3-81f9-4f76-90b1-5127f17af36a"). InnerVolumeSpecName "kube-api-access-mmwm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:05:12.781371 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.781322    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ce619f3-81f9-4f76-90b1-5127f17af36a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ce619f3-81f9-4f76-90b1-5127f17af36a" (UID: "5ce619f3-81f9-4f76-90b1-5127f17af36a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:05:12.880795 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.880700    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmwm4\" (UniqueName: \"kubernetes.io/projected/5ce619f3-81f9-4f76-90b1-5127f17af36a-kube-api-access-mmwm4\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:05:12.880795 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.880732    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ce619f3-81f9-4f76-90b1-5127f17af36a-tls-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:05:12.880795 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.880741    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-dshm\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:05:12.880795 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:12.880752    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ce619f3-81f9-4f76-90b1-5127f17af36a-model-cache\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:05:13.107791 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.107751    2576 generic.go:356] "Generic (PLEG): container finished" podID="5ce619f3-81f9-4f76-90b1-5127f17af36a" containerID="6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45" exitCode=0
Jul 29 20:05:13.107990 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.107807    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"
Jul 29 20:05:13.107990 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.107831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t" event={"ID":"5ce619f3-81f9-4f76-90b1-5127f17af36a","Type":"ContainerDied","Data":"6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45"}
Jul 29 20:05:13.107990 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.107876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t" event={"ID":"5ce619f3-81f9-4f76-90b1-5127f17af36a","Type":"ContainerDied","Data":"343ab86e67ace15762e54896e9038bfb3d19740b89f50aec90d8abcf8f15e997"}
Jul 29 20:05:13.107990 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.107895    2576 scope.go:117] "RemoveContainer" containerID="6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45"
Jul 29 20:05:13.117610 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.117589    2576 scope.go:117] "RemoveContainer" containerID="6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45"
Jul 29 20:05:13.117879 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:05:13.117855    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45\": container with ID starting with 6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45 not found: ID does not exist" containerID="6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45"
Jul 29 20:05:13.117927 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.117890    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45"} err="failed to get container status \"6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45\": rpc error: code = NotFound desc = could not find container \"6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45\": container with ID starting with 6f0630d59b3b501225e1f3f81add842da9c08aaeb4a66fb944547cff3866bc45 not found: ID does not exist"
Jul 29 20:05:13.129682 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.129652    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"]
Jul 29 20:05:13.133910 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:13.133851    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8ef216/rate-test-model-8ef216-kserve-558d4bf9bc-zm22t"]
Jul 29 20:05:14.715609 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:14.715573    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ce619f3-81f9-4f76-90b1-5127f17af36a" path="/var/lib/kubelet/pods/5ce619f3-81f9-4f76-90b1-5127f17af36a/volumes"
Jul 29 20:05:17.461586 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.461527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:17.778227 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.778160    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"]
Jul 29 20:05:17.778822 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.778789    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ce619f3-81f9-4f76-90b1-5127f17af36a" containerName="main"
Jul 29 20:05:17.778822 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.778820    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ce619f3-81f9-4f76-90b1-5127f17af36a" containerName="main"
Jul 29 20:05:17.779015 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.778920    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ce619f3-81f9-4f76-90b1-5127f17af36a" containerName="main"
Jul 29 20:05:17.782249 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.782224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.784892 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.784859    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-d722d0-openshift-default-dockercfg-j4bmd\""
Jul 29 20:05:17.796915 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.796880    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"]
Jul 29 20:05:17.803105 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.803073    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:17.929679 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-certs\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.929872 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-data\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.929872 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-socket\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.929872 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-envoy\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.929872 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istiod-ca-cert\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.930023 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-podinfo\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.930023 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-credential-socket\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.930023 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.929986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-token\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:17.930023 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:17.930005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2br\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-kube-api-access-lc2br\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031280 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-socket\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031280 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-envoy\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031280 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istiod-ca-cert\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031280 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-podinfo\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031666 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-credential-socket\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031666 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-token\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031666 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2br\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-kube-api-access-lc2br\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031666 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-certs\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031666 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-data\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031931 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-socket\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031931 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-credential-socket\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.031931 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-data\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.032035 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.031975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-certs\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.032112 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.032090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istiod-ca-cert\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.033631 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.033608    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-envoy\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.033776 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.033758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-podinfo\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.040040 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.040015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-token\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.040146 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.040096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2br\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-kube-api-access-lc2br\") pod \"e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") " pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.102041 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.101996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:18.244125 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.244096    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"]
Jul 29 20:05:18.246079 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:05:18.246039    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58aacc00_c34f_4db6_a059_1b3c9e0fbb6d.slice/crio-74c1218c9bef97dfab9a4074e14a28413c2bc79661e8ccd229c0e65f5d2d4817 WatchSource:0}: Error finding container 74c1218c9bef97dfab9a4074e14a28413c2bc79661e8ccd229c0e65f5d2d4817: Status 404 returned error can't find the container with id 74c1218c9bef97dfab9a4074e14a28413c2bc79661e8ccd229c0e65f5d2d4817
Jul 29 20:05:18.248334 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.248293    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:05:18.248427 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.248386    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:05:18.248468 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.248428    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:05:18.575521 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:18.575421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:19.142711 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:19.142674    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" event={"ID":"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d","Type":"ContainerStarted","Data":"5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde"}
Jul 29 20:05:19.142906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:19.142739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" event={"ID":"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d","Type":"ContainerStarted","Data":"74c1218c9bef97dfab9a4074e14a28413c2bc79661e8ccd229c0e65f5d2d4817"}
Jul 29 20:05:19.163177 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:19.163124    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" podStartSLOduration=2.163105674 podStartE2EDuration="2.163105674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:19.162121626 +0000 UTC m=+3013.057938920" watchObservedRunningTime="2026-07-29 20:05:19.163105674 +0000 UTC m=+3013.058922940"
Jul 29 20:05:20.102487 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:20.102447    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:20.107732 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:20.107703    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:20.148133 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:20.148103    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:20.149220 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:20.149198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:21.073357 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:21.073300    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:21.178720 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:21.178687    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:21.250011 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:21.249981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:21.723992 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:21.723957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:21.882172 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:21.882135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:38.250886 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:38.250851    2576 generic.go:356] "Generic (PLEG): container finished" podID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerID="5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde" exitCode=0
Jul 29 20:05:38.251331 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:38.250923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" event={"ID":"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d","Type":"ContainerDied","Data":"5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde"}
Jul 29 20:05:38.251331 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:38.251315    2576 scope.go:117] "RemoveContainer" containerID="5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde"
Jul 29 20:05:38.252350 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:38.252326    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:05:38.252420 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:38.252407    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:05:38.252458 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:38.252444    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:05:39.262000 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:39.261956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" event={"ID":"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d","Type":"ContainerStarted","Data":"fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0"}
Jul 29 20:05:40.103081 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:40.103035    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:40.103311 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:40.103288    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Jul 29 20:05:40.103360 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:40.103340    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Jul 29 20:05:41.102956 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:41.102918    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Jul 29 20:05:41.103443 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:41.102975    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Jul 29 20:05:42.102995 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:42.102959    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Jul 29 20:05:42.103409 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:42.103018    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Jul 29 20:05:43.110476 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:43.110446    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:43.110918 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:43.110720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:43.111586 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:43.111530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:05:46.087364 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:46.087331    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:46.832067 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:46.832007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:47.295321 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:47.295272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:47.396896 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:47.396852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:49.867377 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:49.867343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:50.027240 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:50.027199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:50.175753 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:50.175646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:50.348768 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:50.348731    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:51.369357 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:51.369315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:05:51.470058 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:05:51.470023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:06:00.604319 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:06:00.604228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:06:04.607556 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:06:04.607508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:06:11.691718 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:06:11.691680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:06:20.304181 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:06:20.304123    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:06:25.763044 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:06:25.763004    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:07.209921 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.209879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:07.487453 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.487372    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"]
Jul 29 20:07:07.490892 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.490873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.493174 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.493148    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ebceb0-openshift-default-dockercfg-4spm5\""
Jul 29 20:07:07.509983 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.509947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"]
Jul 29 20:07:07.514567 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.514504    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:07.540432 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-data\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540624 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-socket\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540624 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-credential-socket\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540624 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc87fa11-4006-4b14-9087-bc153cff2e3c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540624 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8hdx\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-kube-api-access-t8hdx\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540815 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-podinfo\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540815 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-token\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540815 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-certs\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.540815 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.540767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-envoy\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641673 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-certs\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-envoy\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-data\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-socket\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-credential-socket\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc87fa11-4006-4b14-9087-bc153cff2e3c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8hdx\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-kube-api-access-t8hdx\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.641873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-podinfo\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.642257 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.641896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-token\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.642257 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.642216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-socket\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.642372 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.642264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-credential-socket\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.642445 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.642429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-data\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.642581 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.642528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc87fa11-4006-4b14-9087-bc153cff2e3c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.642659 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.642631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-certs\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.644333 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.644306    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-envoy\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.644492 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.644472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-podinfo\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.662163 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.662125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8hdx\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-kube-api-access-t8hdx\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.671623 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.671599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-token\") pod \"e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") " pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.698991 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.698934    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:07.801800 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.801766    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:07.948384 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.948359    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"]
Jul 29 20:07:07.950179 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:07:07.950152    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc87fa11_4006_4b14_9087_bc153cff2e3c.slice/crio-a6d686413e966b1779d86298c0b1be2691357233edfe3db60eb8b46740048667 WatchSource:0}: Error finding container a6d686413e966b1779d86298c0b1be2691357233edfe3db60eb8b46740048667: Status 404 returned error can't find the container with id a6d686413e966b1779d86298c0b1be2691357233edfe3db60eb8b46740048667
Jul 29 20:07:07.952373 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.952344    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:07:07.952437 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.952409    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:07:07.952476 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:07.952437    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:07:08.748768 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:08.748718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" event={"ID":"bc87fa11-4006-4b14-9087-bc153cff2e3c","Type":"ContainerStarted","Data":"db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77"}
Jul 29 20:07:08.749267 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:08.748787    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" event={"ID":"bc87fa11-4006-4b14-9087-bc153cff2e3c","Type":"ContainerStarted","Data":"a6d686413e966b1779d86298c0b1be2691357233edfe3db60eb8b46740048667"}
Jul 29 20:07:08.771560 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:08.771490    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" podStartSLOduration=1.771473726 podStartE2EDuration="1.771473726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:07:08.768637444 +0000 UTC m=+3122.664454714" watchObservedRunningTime="2026-07-29 20:07:08.771473726 +0000 UTC m=+3122.667291055"
Jul 29 20:07:08.802463 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:08.802426    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:09.807454 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:09.807418    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:10.758821 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:10.758789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:10.759720 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:10.759698    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:10.772329 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:10.772297    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:10.871780 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:10.871745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:11.304418 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.304381    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"]
Jul 29 20:07:11.308063 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.308040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.311352 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.311323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-ebceb0-serving-cert\""
Jul 29 20:07:11.320051 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.320011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"]
Jul 29 20:07:11.342909 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.342877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:11.377116 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.377078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f1f38fd-ccff-4323-944e-ad5657074243-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.377292 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.377210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcf5n\" (UniqueName: \"kubernetes.io/projected/6f1f38fd-ccff-4323-944e-ad5657074243-kube-api-access-mcf5n\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.377292 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.377239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1f38fd-ccff-4323-944e-ad5657074243-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.478211 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.478173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcf5n\" (UniqueName: \"kubernetes.io/projected/6f1f38fd-ccff-4323-944e-ad5657074243-kube-api-access-mcf5n\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.478211 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.478212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1f38fd-ccff-4323-944e-ad5657074243-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.478441 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.478251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f1f38fd-ccff-4323-944e-ad5657074243-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.478932 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.478907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1f38fd-ccff-4323-944e-ad5657074243-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.480795 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.480775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f1f38fd-ccff-4323-944e-ad5657074243-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.488518 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.488487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcf5n\" (UniqueName: \"kubernetes.io/projected/6f1f38fd-ccff-4323-944e-ad5657074243-kube-api-access-mcf5n\") pod \"maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.577011 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.576902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:11.619928 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.619880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:11.767797 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.767773    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"]
Jul 29 20:07:11.769260 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:07:11.769233    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1f38fd_ccff_4323_944e_ad5657074243.slice/crio-f8c7468985fe44ab915163e59bd4d265bd2de4aeb49bf47c0185705bc425bf09 WatchSource:0}: Error finding container f8c7468985fe44ab915163e59bd4d265bd2de4aeb49bf47c0185705bc425bf09: Status 404 returned error can't find the container with id f8c7468985fe44ab915163e59bd4d265bd2de4aeb49bf47c0185705bc425bf09
Jul 29 20:07:11.770697 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.770676    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 20:07:11.820160 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.820127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:11.921924 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:11.921838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:12.772145 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:12.772108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z" event={"ID":"6f1f38fd-ccff-4323-944e-ad5657074243","Type":"ContainerStarted","Data":"50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197"}
Jul 29 20:07:12.772307 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:12.772164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z" event={"ID":"6f1f38fd-ccff-4323-944e-ad5657074243","Type":"ContainerStarted","Data":"f8c7468985fe44ab915163e59bd4d265bd2de4aeb49bf47c0185705bc425bf09"}
Jul 29 20:07:12.798385 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:12.798330    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z" podStartSLOduration=1.442387519 podStartE2EDuration="1.798315019s" totalImagesPullingTime="355.9275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:07:12.795491532 +0000 UTC m=+3126.691308801" watchObservedRunningTime="2026-07-29 20:07:12.798315019 +0000 UTC m=+3126.694132287"
Jul 29 20:07:13.777772 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:13.777733    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:19.788102 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:19.788067    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:23.834648 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:23.834596    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerID="db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77" exitCode=0
Jul 29 20:07:23.835156 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:23.834671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" event={"ID":"bc87fa11-4006-4b14-9087-bc153cff2e3c","Type":"ContainerDied","Data":"db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77"}
Jul 29 20:07:23.835156 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:23.835130    2576 scope.go:117] "RemoveContainer" containerID="db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77"
Jul 29 20:07:23.836427 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:23.836390    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:07:23.836561 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:23.836504    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:07:23.836615 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:23.836563    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:07:24.853321 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:24.853257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" event={"ID":"bc87fa11-4006-4b14-9087-bc153cff2e3c","Type":"ContainerStarted","Data":"6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4"}
Jul 29 20:07:25.475998 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:25.475964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:25.759056 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:25.759012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:25.802703 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:25.802659    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:25.804014 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:25.803977    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 29 20:07:25.804145 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:25.804058    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 29 20:07:26.802365 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:26.802327    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 29 20:07:26.802809 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:26.802394    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 29 20:07:27.802874 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:27.802832    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 29 20:07:27.803294 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:27.802890    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 29 20:07:28.806706 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:28.806671    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:28.807677 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:28.807656    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:35.581785 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.581748    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"]
Jul 29 20:07:35.582209 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.581953    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z" podUID="6f1f38fd-ccff-4323-944e-ad5657074243" containerName="maas-api" containerID="cri-o://50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197" gracePeriod=30
Jul 29 20:07:35.640511 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.640477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:35.758836 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.758596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:35.843837 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.843768    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:35.860015 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.859980    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:35.923302 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.923269    2576 generic.go:356] "Generic (PLEG): container finished" podID="6f1f38fd-ccff-4323-944e-ad5657074243" containerID="50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197" exitCode=0
Jul 29 20:07:35.923508 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.923322    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"
Jul 29 20:07:35.923508 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.923355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z" event={"ID":"6f1f38fd-ccff-4323-944e-ad5657074243","Type":"ContainerDied","Data":"50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197"}
Jul 29 20:07:35.923508 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.923422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z" event={"ID":"6f1f38fd-ccff-4323-944e-ad5657074243","Type":"ContainerDied","Data":"f8c7468985fe44ab915163e59bd4d265bd2de4aeb49bf47c0185705bc425bf09"}
Jul 29 20:07:35.923508 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.923454    2576 scope.go:117] "RemoveContainer" containerID="50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197"
Jul 29 20:07:35.927516 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.927490    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f1f38fd-ccff-4323-944e-ad5657074243-maas-api-tls\") pod \"6f1f38fd-ccff-4323-944e-ad5657074243\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") "
Jul 29 20:07:35.927647 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.927592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1f38fd-ccff-4323-944e-ad5657074243-openshift-service-ca\") pod \"6f1f38fd-ccff-4323-944e-ad5657074243\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") "
Jul 29 20:07:35.927647 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.927637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcf5n\" (UniqueName: \"kubernetes.io/projected/6f1f38fd-ccff-4323-944e-ad5657074243-kube-api-access-mcf5n\") pod \"6f1f38fd-ccff-4323-944e-ad5657074243\" (UID: \"6f1f38fd-ccff-4323-944e-ad5657074243\") "
Jul 29 20:07:35.928045 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.928017    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1f38fd-ccff-4323-944e-ad5657074243-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f1f38fd-ccff-4323-944e-ad5657074243" (UID: "6f1f38fd-ccff-4323-944e-ad5657074243"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:07:35.929829 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.929801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1f38fd-ccff-4323-944e-ad5657074243-kube-api-access-mcf5n" (OuterVolumeSpecName: "kube-api-access-mcf5n") pod "6f1f38fd-ccff-4323-944e-ad5657074243" (UID: "6f1f38fd-ccff-4323-944e-ad5657074243"). InnerVolumeSpecName "kube-api-access-mcf5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:07:35.930076 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.930048    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f1f38fd-ccff-4323-944e-ad5657074243-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f1f38fd-ccff-4323-944e-ad5657074243" (UID: "6f1f38fd-ccff-4323-944e-ad5657074243"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:07:35.933608 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.933520    2576 scope.go:117] "RemoveContainer" containerID="50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197"
Jul 29 20:07:35.934005 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:07:35.933982    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197\": container with ID starting with 50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197 not found: ID does not exist" containerID="50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197"
Jul 29 20:07:35.934096 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.934016    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197"} err="failed to get container status \"50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197\": rpc error: code = NotFound desc = could not find container \"50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197\": container with ID starting with 50a6a1d3c3c4a239d1a90bfdc4f248ce65781d6b86c413ae107f4dc3572a8197 not found: ID does not exist"
Jul 29 20:07:35.959714 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:35.959678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:36.028329 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:36.028296    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f1f38fd-ccff-4323-944e-ad5657074243-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:36.028329 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:36.028325    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1f38fd-ccff-4323-944e-ad5657074243-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:36.028329 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:36.028336    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcf5n\" (UniqueName: \"kubernetes.io/projected/6f1f38fd-ccff-4323-944e-ad5657074243-kube-api-access-mcf5n\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:36.246432 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:36.246389    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"]
Jul 29 20:07:36.250394 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:36.250360    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:36.253191 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:36.253160    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebceb0-6b846568f4-trv2z"]
Jul 29 20:07:36.715249 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:36.715211    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1f38fd-ccff-4323-944e-ad5657074243" path="/var/lib/kubelet/pods/6f1f38fd-ccff-4323-944e-ad5657074243/volumes"
Jul 29 20:07:42.315136 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:42.315098    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:42.415045 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:42.415008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:42.555725 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:42.555690    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"]
Jul 29 20:07:42.555948 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:42.555922    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy" containerID="cri-o://6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4" gracePeriod=30
Jul 29 20:07:42.567630 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:42.567530    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:42.787674 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:42.787640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:43.809797 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:43.809754    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 20:07:43.810199 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:43.809833    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:07:47.813877 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.813846    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:47.943051 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.942955    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-credential-socket\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943051 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943009    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc87fa11-4006-4b14-9087-bc153cff2e3c-istiod-ca-cert\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943051 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8hdx\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-kube-api-access-t8hdx\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943348 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-podinfo\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943348 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943106    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-token\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943348 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943133    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-envoy\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943348 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943174    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-certs\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943348 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-data\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943348 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943257    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-socket\") pod \"bc87fa11-4006-4b14-9087-bc153cff2e3c\" (UID: \"bc87fa11-4006-4b14-9087-bc153cff2e3c\") "
Jul 29 20:07:47.943348 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943294    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:07:47.943857 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943471    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:07:47.943857 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943561    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:47.943857 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:07:47.943857 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.943810    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc87fa11-4006-4b14-9087-bc153cff2e3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:07:47.944180 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.944157    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:07:47.945539 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.945510    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:07:47.945539 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.945524    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-kube-api-access-t8hdx" (OuterVolumeSpecName: "kube-api-access-t8hdx") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "kube-api-access-t8hdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:07:47.945753 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.945726    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:07:47.945805 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.945744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc87fa11-4006-4b14-9087-bc153cff2e3c" (UID: "bc87fa11-4006-4b14-9087-bc153cff2e3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:07:47.994969 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.994931    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerID="6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4" exitCode=0
Jul 29 20:07:47.995141 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.994979    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"
Jul 29 20:07:47.995141 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.995019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" event={"ID":"bc87fa11-4006-4b14-9087-bc153cff2e3c","Type":"ContainerDied","Data":"6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4"}
Jul 29 20:07:47.995141 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.995081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq" event={"ID":"bc87fa11-4006-4b14-9087-bc153cff2e3c","Type":"ContainerDied","Data":"a6d686413e966b1779d86298c0b1be2691357233edfe3db60eb8b46740048667"}
Jul 29 20:07:47.995141 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:47.995106    2576 scope.go:117] "RemoveContainer" containerID="6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4"
Jul 29 20:07:48.004997 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.004973    2576 scope.go:117] "RemoveContainer" containerID="db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77"
Jul 29 20:07:48.014935 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.014910    2576 scope.go:117] "RemoveContainer" containerID="6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4"
Jul 29 20:07:48.015240 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:07:48.015220    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4\": container with ID starting with 6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4 not found: ID does not exist" containerID="6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4"
Jul 29 20:07:48.015293 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.015251    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4"} err="failed to get container status \"6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4\": rpc error: code = NotFound desc = could not find container \"6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4\": container with ID starting with 6ac840a2e7a98dc322bc34e1db019c73baf7164e0506ea2271599a89fe08e5d4 not found: ID does not exist"
Jul 29 20:07:48.015293 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.015270    2576 scope.go:117] "RemoveContainer" containerID="db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77"
Jul 29 20:07:48.015605 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:07:48.015563    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77\": container with ID starting with db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77 not found: ID does not exist" containerID="db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77"
Jul 29 20:07:48.015605 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.015599    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77"} err="failed to get container status \"db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77\": rpc error: code = NotFound desc = could not find container \"db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77\": container with ID starting with db0f6d33e7ae5721661dcbb6187793bccd9a10917cce5a662bb5027645dc8a77 not found: ID does not exist"
Jul 29 20:07:48.016258 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.016236    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"]
Jul 29 20:07:48.020063 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.020037    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebceb0-openshift-default-d984d776b-qdxkq"]
Jul 29 20:07:48.045023 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.044986    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.045023 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.045018    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.045023 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.045030    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.045278 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.045042    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc87fa11-4006-4b14-9087-bc153cff2e3c-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.045278 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.045056    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8hdx\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-kube-api-access-t8hdx\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.045278 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.045068    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.045278 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.045079    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.045278 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.045089    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc87fa11-4006-4b14-9087-bc153cff2e3c-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:07:48.715274 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:48.715241    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" path="/var/lib/kubelet/pods/bc87fa11-4006-4b14-9087-bc153cff2e3c/volumes"
Jul 29 20:07:58.805252 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:58.805204    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:58.874614 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:58.874573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:58.935536 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:58.935495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:59.037478 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:59.037433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:07:59.464124 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:07:59.464088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:04.491645 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:04.491606    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:14.174534 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:14.174495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:18.619878 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:18.619820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:41.555166 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:41.555113    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:41.746925 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:41.746889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:47.535997 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:47.535934    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:47.797315 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:47.797223    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"]
Jul 29 20:08:47.797497 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:47.797473    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy" containerID="cri-o://fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0" gracePeriod=30
Jul 29 20:08:49.186254 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:49.186199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:53.065598 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.065503    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:08:53.070785 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.070761    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-certs\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.070866 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.070802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-credential-socket\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.070866 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.070828    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-podinfo\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.070955 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.070872    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-token\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.070955 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.070905    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istiod-ca-cert\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.070955 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.070926    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc2br\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-kube-api-access-lc2br\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.071114 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.071052    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:53.071114 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.071070    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-envoy\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.071223 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.071070    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:53.071333 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.071306    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:08:53.071436 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.071420    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.071495 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.071442    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.071495 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.071457    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.073024 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.072996    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:53.073024 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.072999    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:08:53.073413 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.073390    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:53.073494 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.073428    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-kube-api-access-lc2br" (OuterVolumeSpecName: "kube-api-access-lc2br") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "kube-api-access-lc2br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:53.172499 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172468    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-data\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.172499 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-socket\") pod \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\" (UID: \"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d\") "
Jul 29 20:08:53.172803 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:53.172887 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172864    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.172927 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172893    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.172927 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172905    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.172927 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172914    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc2br\" (UniqueName: \"kubernetes.io/projected/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-kube-api-access-lc2br\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.172927 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.172925    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.173207 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.173185    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" (UID: "58aacc00-c34f-4db6-a059-1b3c9e0fbb6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:08:53.273670 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.273634    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:08:53.368409 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.368326    2576 generic.go:356] "Generic (PLEG): container finished" podID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerID="fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0" exitCode=0
Jul 29 20:08:53.368409 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.368380    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"
Jul 29 20:08:53.368625 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.368415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" event={"ID":"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d","Type":"ContainerDied","Data":"fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0"}
Jul 29 20:08:53.368625 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.368479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt" event={"ID":"58aacc00-c34f-4db6-a059-1b3c9e0fbb6d","Type":"ContainerDied","Data":"74c1218c9bef97dfab9a4074e14a28413c2bc79661e8ccd229c0e65f5d2d4817"}
Jul 29 20:08:53.368625 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.368509    2576 scope.go:117] "RemoveContainer" containerID="fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0"
Jul 29 20:08:53.378464 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.378444    2576 scope.go:117] "RemoveContainer" containerID="5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde"
Jul 29 20:08:53.386720 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.386700    2576 scope.go:117] "RemoveContainer" containerID="fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0"
Jul 29 20:08:53.387094 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:08:53.387034    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0\": container with ID starting with fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0 not found: ID does not exist" containerID="fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0"
Jul 29 20:08:53.387209 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.387103    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0"} err="failed to get container status \"fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0\": rpc error: code = NotFound desc = could not find container \"fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0\": container with ID starting with fd945d558d4ff966c8501584ebd3f6425e9bb8a1583361063008e84fb4d18cc0 not found: ID does not exist"
Jul 29 20:08:53.387209 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.387128    2576 scope.go:117] "RemoveContainer" containerID="5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde"
Jul 29 20:08:53.387874 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:08:53.387851    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde\": container with ID starting with 5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde not found: ID does not exist" containerID="5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde"
Jul 29 20:08:53.387957 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.387884    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde"} err="failed to get container status \"5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde\": rpc error: code = NotFound desc = could not find container \"5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde\": container with ID starting with 5693a391be279e05c8be04a7fc2e9cc2e0cc8b098f09f5b2165999772bf0fcde not found: ID does not exist"
Jul 29 20:08:53.389990 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.389968    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"]
Jul 29 20:08:53.393651 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:53.393630    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-d722d0-openshift-default-5bb568fc4d-8ffvt"]
Jul 29 20:08:54.267734 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:54.267702    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:54.369297 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:54.369239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:54.465690 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:54.465653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:08:54.716040 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:54.715953    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" path="/var/lib/kubelet/pods/58aacc00-c34f-4db6-a059-1b3c9e0fbb6d/volumes"
Jul 29 20:08:54.807902 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:08:54.807866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:00.956259 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:00.956168    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:01.055659 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.055630    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:01.236450 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.236357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:01.481457 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.481426    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:01.635969 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.635929    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"]
Jul 29 20:09:01.636315 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636301    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy"
Jul 29 20:09:01.636365 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636316    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy"
Jul 29 20:09:01.636365 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636331    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy"
Jul 29 20:09:01.636365 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636337    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy"
Jul 29 20:09:01.636365 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636359    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636368    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636379    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1f38fd-ccff-4323-944e-ad5657074243" containerName="maas-api"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636385    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1f38fd-ccff-4323-944e-ad5657074243" containerName="maas-api"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636438    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636449    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636458    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1f38fd-ccff-4323-944e-ad5657074243" containerName="maas-api"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636466    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy"
Jul 29 20:09:01.636486 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.636473    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58aacc00-c34f-4db6-a059-1b3c9e0fbb6d" containerName="istio-proxy"
Jul 29 20:09:01.641118 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.641092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"
Jul 29 20:09:01.643154 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.643133    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\""
Jul 29 20:09:01.648534 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.648506    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"]
Jul 29 20:09:01.755819 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.755787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3db9872-9e1d-4cfb-b680-fd11556213d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5\" (UID: \"c3db9872-9e1d-4cfb-b680-fd11556213d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"
Jul 29 20:09:01.857282 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.857245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3db9872-9e1d-4cfb-b680-fd11556213d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5\" (UID: \"c3db9872-9e1d-4cfb-b680-fd11556213d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"
Jul 29 20:09:01.857952 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.857932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3db9872-9e1d-4cfb-b680-fd11556213d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5\" (UID: \"c3db9872-9e1d-4cfb-b680-fd11556213d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"
Jul 29 20:09:01.954808 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:01.954715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"
Jul 29 20:09:02.093090 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:02.093066    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"]
Jul 29 20:09:02.095158 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:09:02.095133    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3db9872_9e1d_4cfb_b680_fd11556213d7.slice/crio-470c98bf9df8efbbf59b85b8d9c5dee93eacff16fded0831cfdf04ce07d75cbd WatchSource:0}: Error finding container 470c98bf9df8efbbf59b85b8d9c5dee93eacff16fded0831cfdf04ce07d75cbd: Status 404 returned error can't find the container with id 470c98bf9df8efbbf59b85b8d9c5dee93eacff16fded0831cfdf04ce07d75cbd
Jul 29 20:09:02.425466 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:02.425417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5" event={"ID":"c3db9872-9e1d-4cfb-b680-fd11556213d7","Type":"ContainerStarted","Data":"e371be43ba3f362c7376b152b174d1f89ba2b40a89fabe174e748346c8166be7"}
Jul 29 20:09:02.425666 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:02.425483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5" event={"ID":"c3db9872-9e1d-4cfb-b680-fd11556213d7","Type":"ContainerStarted","Data":"470c98bf9df8efbbf59b85b8d9c5dee93eacff16fded0831cfdf04ce07d75cbd"}
Jul 29 20:09:02.440298 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:02.440224    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5" podStartSLOduration=1.440208198 podStartE2EDuration="1.440208198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:02.43848661 +0000 UTC m=+3236.334303904" watchObservedRunningTime="2026-07-29 20:09:02.440208198 +0000 UTC m=+3236.336025468"
Jul 29 20:09:03.432922 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:03.432878    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3db9872-9e1d-4cfb-b680-fd11556213d7" containerID="e371be43ba3f362c7376b152b174d1f89ba2b40a89fabe174e748346c8166be7" exitCode=0
Jul 29 20:09:03.433331 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:03.432972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5" event={"ID":"c3db9872-9e1d-4cfb-b680-fd11556213d7","Type":"ContainerDied","Data":"e371be43ba3f362c7376b152b174d1f89ba2b40a89fabe174e748346c8166be7"}
Jul 29 20:09:04.586420 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:04.586392    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"
Jul 29 20:09:04.681612 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:04.681575    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3db9872-9e1d-4cfb-b680-fd11556213d7-maas-api-service-ca\") pod \"c3db9872-9e1d-4cfb-b680-fd11556213d7\" (UID: \"c3db9872-9e1d-4cfb-b680-fd11556213d7\") "
Jul 29 20:09:04.681958 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:04.681934    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3db9872-9e1d-4cfb-b680-fd11556213d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3db9872-9e1d-4cfb-b680-fd11556213d7" (UID: "c3db9872-9e1d-4cfb-b680-fd11556213d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:04.782889 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:04.782841    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3db9872-9e1d-4cfb-b680-fd11556213d7-maas-api-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:05.446215 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:05.446179    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"
Jul 29 20:09:05.446437 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:05.446216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5" event={"ID":"c3db9872-9e1d-4cfb-b680-fd11556213d7","Type":"ContainerDied","Data":"470c98bf9df8efbbf59b85b8d9c5dee93eacff16fded0831cfdf04ce07d75cbd"}
Jul 29 20:09:05.446437 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:05.446296    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="470c98bf9df8efbbf59b85b8d9c5dee93eacff16fded0831cfdf04ce07d75cbd"
Jul 29 20:09:06.831097 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:06.831034    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"]
Jul 29 20:09:06.831596 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:06.831376    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l" podUID="c052fc24-dbf6-4833-aa0f-609226986e7a" containerName="maas-api" containerID="cri-o://deb99203e9110602c2a5c258c9daca539fcba05cb71376acd160149dda26dacf" gracePeriod=30
Jul 29 20:09:06.854841 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:06.854808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:06.860051 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:06.860021    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"]
Jul 29 20:09:06.862235 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:06.862211    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9a3702-29755920-5t4ck"]
Jul 29 20:09:06.931844 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:06.931810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:06.990302 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:06.990268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:07.051151 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.051117    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"]
Jul 29 20:09:07.053052 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.053019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:07.054281 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.054250    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9a3702-qqzs5"]
Jul 29 20:09:07.097833 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.097767    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 20:09:07.117703 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.117674    2576 scope.go:117] "RemoveContainer" containerID="deb99203e9110602c2a5c258c9daca539fcba05cb71376acd160149dda26dacf"
Jul 29 20:09:07.205093 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.205063    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c052fc24-dbf6-4833-aa0f-609226986e7a-maas-api-tls\") pod \"c052fc24-dbf6-4833-aa0f-609226986e7a\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") "
Jul 29 20:09:07.205269 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.205110    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdlv9\" (UniqueName: \"kubernetes.io/projected/c052fc24-dbf6-4833-aa0f-609226986e7a-kube-api-access-qdlv9\") pod \"c052fc24-dbf6-4833-aa0f-609226986e7a\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") "
Jul 29 20:09:07.205269 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.205179    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c052fc24-dbf6-4833-aa0f-609226986e7a-openshift-service-ca\") pod \"c052fc24-dbf6-4833-aa0f-609226986e7a\" (UID: \"c052fc24-dbf6-4833-aa0f-609226986e7a\") "
Jul 29 20:09:07.205591 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.205561    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c052fc24-dbf6-4833-aa0f-609226986e7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c052fc24-dbf6-4833-aa0f-609226986e7a" (UID: "c052fc24-dbf6-4833-aa0f-609226986e7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:07.207311 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.207277    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c052fc24-dbf6-4833-aa0f-609226986e7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c052fc24-dbf6-4833-aa0f-609226986e7a" (UID: "c052fc24-dbf6-4833-aa0f-609226986e7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:09:07.207433 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.207412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c052fc24-dbf6-4833-aa0f-609226986e7a-kube-api-access-qdlv9" (OuterVolumeSpecName: "kube-api-access-qdlv9") pod "c052fc24-dbf6-4833-aa0f-609226986e7a" (UID: "c052fc24-dbf6-4833-aa0f-609226986e7a"). InnerVolumeSpecName "kube-api-access-qdlv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:07.306062 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.306020    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c052fc24-dbf6-4833-aa0f-609226986e7a-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:07.306062 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.306054    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdlv9\" (UniqueName: \"kubernetes.io/projected/c052fc24-dbf6-4833-aa0f-609226986e7a-kube-api-access-qdlv9\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:07.306062 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.306064    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c052fc24-dbf6-4833-aa0f-609226986e7a-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:07.408623 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.408497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:07.457804 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.457769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"
Jul 29 20:09:07.457979 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.457804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l" event={"ID":"c052fc24-dbf6-4833-aa0f-609226986e7a","Type":"ContainerDied","Data":"deb99203e9110602c2a5c258c9daca539fcba05cb71376acd160149dda26dacf"}
Jul 29 20:09:07.457979 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.457859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l" event={"ID":"c052fc24-dbf6-4833-aa0f-609226986e7a","Type":"ContainerDied","Data":"b1d6e800c1a4c61d276f985b5da3cdf20c037bb0f0c62e4dc608f994f567f20a"}
Jul 29 20:09:07.486292 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.486254    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"]
Jul 29 20:09:07.489178 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:07.489146    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9a3702-589df88866-hnv6l"]
Jul 29 20:09:08.715752 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:08.715709    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c052fc24-dbf6-4833-aa0f-609226986e7a" path="/var/lib/kubelet/pods/c052fc24-dbf6-4833-aa0f-609226986e7a/volumes"
Jul 29 20:09:08.716240 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:08.716186    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3db9872-9e1d-4cfb-b680-fd11556213d7" path="/var/lib/kubelet/pods/c3db9872-9e1d-4cfb-b680-fd11556213d7/volumes"
Jul 29 20:09:08.716501 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:08.716480    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdacfade-e299-4456-aa5d-a52c4938a79d" path="/var/lib/kubelet/pods/fdacfade-e299-4456-aa5d-a52c4938a79d/volumes"
Jul 29 20:09:13.872278 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:13.872235    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:13.944531 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:13.944497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:14.114617 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:14.114576    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"]
Jul 29 20:09:14.114825 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:14.114798    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy" containerID="cri-o://160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd" gracePeriod=30
Jul 29 20:09:14.134300 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:14.134216    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:14.361059 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:14.361023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:19.366912 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.366877    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 20:09:19.516683 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516648    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-envoy\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.516906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516703    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/263bbd28-08e2-4f72-b895-ed4b12288830-istiod-ca-cert\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.516906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516734    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-socket\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.516906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-certs\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.516906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-data\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.516906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516850    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2t9m\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-kube-api-access-c2t9m\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.516906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516866    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-istio-token\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.516906 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516893    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-credential-socket\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.517264 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.516916    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/263bbd28-08e2-4f72-b895-ed4b12288830-istio-podinfo\") pod \"263bbd28-08e2-4f72-b895-ed4b12288830\" (UID: \"263bbd28-08e2-4f72-b895-ed4b12288830\") "
Jul 29 20:09:19.517264 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.517108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:19.517264 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.517138    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/263bbd28-08e2-4f72-b895-ed4b12288830-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:19.517427 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.517383    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:19.517493 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.517416    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:19.518238 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.518205    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-data" (OuterVolumeSpecName: "istio-data") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:19.519351 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.519215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-kube-api-access-c2t9m" (OuterVolumeSpecName: "kube-api-access-c2t9m") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "kube-api-access-c2t9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:19.519351 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.519272    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/263bbd28-08e2-4f72-b895-ed4b12288830-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:09:19.519351 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.519313    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:19.519597 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.519404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-istio-token" (OuterVolumeSpecName: "istio-token") pod "263bbd28-08e2-4f72-b895-ed4b12288830" (UID: "263bbd28-08e2-4f72-b895-ed4b12288830"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:19.524889 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.524756    2576 generic.go:356] "Generic (PLEG): container finished" podID="263bbd28-08e2-4f72-b895-ed4b12288830" containerID="160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd" exitCode=0
Jul 29 20:09:19.524889 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.524858    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"
Jul 29 20:09:19.524889 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.524869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" event={"ID":"263bbd28-08e2-4f72-b895-ed4b12288830","Type":"ContainerDied","Data":"160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd"}
Jul 29 20:09:19.525191 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.524938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472" event={"ID":"263bbd28-08e2-4f72-b895-ed4b12288830","Type":"ContainerDied","Data":"63f5dba3ce9b0c28558b98544707efd0bfc6f1d21b447860864060bf01bd0f30"}
Jul 29 20:09:19.525191 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.524972    2576 scope.go:117] "RemoveContainer" containerID="160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd"
Jul 29 20:09:19.538389 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.538367    2576 scope.go:117] "RemoveContainer" containerID="58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2"
Jul 29 20:09:19.546997 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.546977    2576 scope.go:117] "RemoveContainer" containerID="160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd"
Jul 29 20:09:19.547353 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:09:19.547324    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd\": container with ID starting with 160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd not found: ID does not exist" containerID="160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd"
Jul 29 20:09:19.547353 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.547363    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd"} err="failed to get container status \"160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd\": rpc error: code = NotFound desc = could not find container \"160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd\": container with ID starting with 160fb3179b02ea6ca2a2ccbc0ab64cd1d96153c829ea2f6ea818b6991457c9cd not found: ID does not exist"
Jul 29 20:09:19.547353 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.547385    2576 scope.go:117] "RemoveContainer" containerID="58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2"
Jul 29 20:09:19.547848 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:09:19.547789    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2\": container with ID starting with 58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2 not found: ID does not exist" containerID="58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2"
Jul 29 20:09:19.547848 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.547816    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2"} err="failed to get container status \"58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2\": rpc error: code = NotFound desc = could not find container \"58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2\": container with ID starting with 58f8116160c333f037cd71ca7d8d0ac2ac4d5a33edc21c64197d9d0d9a620dd2 not found: ID does not exist"
Jul 29 20:09:19.550996 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.550966    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"]
Jul 29 20:09:19.555820 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.555795    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9a3702-openshift-default-6d9c9f9f6-mb472"]
Jul 29 20:09:19.617764 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617732    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617764 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617760    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617976 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617772    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2t9m\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-kube-api-access-c2t9m\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617976 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617782    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/263bbd28-08e2-4f72-b895-ed4b12288830-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617976 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617793    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617976 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617802    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/263bbd28-08e2-4f72-b895-ed4b12288830-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617976 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617810    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617976 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617818    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/263bbd28-08e2-4f72-b895-ed4b12288830-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:19.617976 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:19.617825    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/263bbd28-08e2-4f72-b895-ed4b12288830-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:20.333313 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.333272    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"]
Jul 29 20:09:20.333613 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.333571    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj" podUID="38999cd4-0508-43df-a6c9-cf9823b7d09b" containerName="maas-api" containerID="cri-o://124852464ebecd1dace759430f71aa0d1e3028294f00dd80ab7e52983bbc72be" gracePeriod=30
Jul 29 20:09:20.362848 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.362810    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"]
Jul 29 20:09:20.365040 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.365013    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8ef216-29755920-dxzpx"]
Jul 29 20:09:20.533771 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.533558    2576 generic.go:356] "Generic (PLEG): container finished" podID="38999cd4-0508-43df-a6c9-cf9823b7d09b" containerID="124852464ebecd1dace759430f71aa0d1e3028294f00dd80ab7e52983bbc72be" exitCode=0
Jul 29 20:09:20.533771 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.533706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj" event={"ID":"38999cd4-0508-43df-a6c9-cf9823b7d09b","Type":"ContainerDied","Data":"124852464ebecd1dace759430f71aa0d1e3028294f00dd80ab7e52983bbc72be"}
Jul 29 20:09:20.592071 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.592001    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 20:09:20.715265 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.715231    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" path="/var/lib/kubelet/pods/263bbd28-08e2-4f72-b895-ed4b12288830/volumes"
Jul 29 20:09:20.715577 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.715536    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b95d4f14-cfe1-49f0-ba21-7628904d06c1" path="/var/lib/kubelet/pods/b95d4f14-cfe1-49f0-ba21-7628904d06c1/volumes"
Jul 29 20:09:20.730694 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.730662    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx5mw\" (UniqueName: \"kubernetes.io/projected/38999cd4-0508-43df-a6c9-cf9823b7d09b-kube-api-access-tx5mw\") pod \"38999cd4-0508-43df-a6c9-cf9823b7d09b\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") "
Jul 29 20:09:20.730870 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.730760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38999cd4-0508-43df-a6c9-cf9823b7d09b-openshift-service-ca\") pod \"38999cd4-0508-43df-a6c9-cf9823b7d09b\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") "
Jul 29 20:09:20.730870 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.730805    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls\") pod \"38999cd4-0508-43df-a6c9-cf9823b7d09b\" (UID: \"38999cd4-0508-43df-a6c9-cf9823b7d09b\") "
Jul 29 20:09:20.731126 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.731099    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38999cd4-0508-43df-a6c9-cf9823b7d09b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38999cd4-0508-43df-a6c9-cf9823b7d09b" (UID: "38999cd4-0508-43df-a6c9-cf9823b7d09b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:20.732874 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.732847    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38999cd4-0508-43df-a6c9-cf9823b7d09b" (UID: "38999cd4-0508-43df-a6c9-cf9823b7d09b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:09:20.733016 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.732961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38999cd4-0508-43df-a6c9-cf9823b7d09b-kube-api-access-tx5mw" (OuterVolumeSpecName: "kube-api-access-tx5mw") pod "38999cd4-0508-43df-a6c9-cf9823b7d09b" (UID: "38999cd4-0508-43df-a6c9-cf9823b7d09b"). InnerVolumeSpecName "kube-api-access-tx5mw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:20.832453 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.832411    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38999cd4-0508-43df-a6c9-cf9823b7d09b-openshift-service-ca\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:20.832453 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.832444    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38999cd4-0508-43df-a6c9-cf9823b7d09b-maas-api-tls\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:20.832453 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:20.832455    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx5mw\" (UniqueName: \"kubernetes.io/projected/38999cd4-0508-43df-a6c9-cf9823b7d09b-kube-api-access-tx5mw\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:21.416945 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:21.416909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:21.496404 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:21.496369    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:21.541561 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:21.541516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj" event={"ID":"38999cd4-0508-43df-a6c9-cf9823b7d09b","Type":"ContainerDied","Data":"8c7b4cd77a1dc97e09101d4640a54091bb21749f2b6f358117aa6a2e24fbf553"}
Jul 29 20:09:21.541561 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:21.541537    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"
Jul 29 20:09:21.542071 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:21.541605    2576 scope.go:117] "RemoveContainer" containerID="124852464ebecd1dace759430f71aa0d1e3028294f00dd80ab7e52983bbc72be"
Jul 29 20:09:21.562182 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:21.562151    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"]
Jul 29 20:09:21.565693 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:21.565669    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8ef216-6c967746dc-qmvmj"]
Jul 29 20:09:22.715310 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:22.715273    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38999cd4-0508-43df-a6c9-cf9823b7d09b" path="/var/lib/kubelet/pods/38999cd4-0508-43df-a6c9-cf9823b7d09b/volumes"
Jul 29 20:09:26.901294 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:26.901250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:26.956232 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:26.956194    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:27.141781 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:27.141745    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"]
Jul 29 20:09:27.141982 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:27.141954    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy" containerID="cri-o://310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92" gracePeriod=30
Jul 29 20:09:27.164707 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:27.164627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:27.400199 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:27.400146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:32.393617 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.393586    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 20:09:32.540645 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540605    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-data\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.540848 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540658    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-envoy\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.540848 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540685    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md5bc\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-kube-api-access-md5bc\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.540848 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540708    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-credential-socket\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.540848 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-token\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.541091 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-certs\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.541091 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540907    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-podinfo\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.541091 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.540973    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-socket\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.541091 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.541015    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istiod-ca-cert\") pod \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\" (UID: \"18e229bc-d651-4ce3-9a29-30ab7ef94f95\") "
Jul 29 20:09:32.541295 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.541149    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:32.541389 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.541368    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-certs\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.541457 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.541433    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:32.541513 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.541476    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:09:32.541611 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.541591    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:32.541673 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.541631    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-data" (OuterVolumeSpecName: "istio-data") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:32.543028 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.543008    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:09:32.543120 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.543028    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-kube-api-access-md5bc" (OuterVolumeSpecName: "kube-api-access-md5bc") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "kube-api-access-md5bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:32.543308 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.543292    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-token" (OuterVolumeSpecName: "istio-token") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:32.543386 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.543365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18e229bc-d651-4ce3-9a29-30ab7ef94f95" (UID: "18e229bc-d651-4ce3-9a29-30ab7ef94f95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:09:32.599929 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.599890    2576 generic.go:356] "Generic (PLEG): container finished" podID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerID="310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92" exitCode=0
Jul 29 20:09:32.600085 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.599939    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"
Jul 29 20:09:32.600085 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.599973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" event={"ID":"18e229bc-d651-4ce3-9a29-30ab7ef94f95","Type":"ContainerDied","Data":"310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92"}
Jul 29 20:09:32.600085 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.600030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv" event={"ID":"18e229bc-d651-4ce3-9a29-30ab7ef94f95","Type":"ContainerDied","Data":"a6b667a0746d7bfd3761e6bebfd42bcd06e81893b48a074260b0fa3cbba5c255"}
Jul 29 20:09:32.600085 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.600054    2576 scope.go:117] "RemoveContainer" containerID="310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92"
Jul 29 20:09:32.609811 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.609793    2576 scope.go:117] "RemoveContainer" containerID="2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548"
Jul 29 20:09:32.618097 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.618077    2576 scope.go:117] "RemoveContainer" containerID="310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92"
Jul 29 20:09:32.618383 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:09:32.618366    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92\": container with ID starting with 310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92 not found: ID does not exist" containerID="310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92"
Jul 29 20:09:32.618443 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.618391    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92"} err="failed to get container status \"310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92\": rpc error: code = NotFound desc = could not find container \"310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92\": container with ID starting with 310b580a3b6399c36bb034fb2fc3914b712856efcedbdcd8fb5e095f3d92cd92 not found: ID does not exist"
Jul 29 20:09:32.618443 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.618408    2576 scope.go:117] "RemoveContainer" containerID="2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548"
Jul 29 20:09:32.618652 ip-10-0-131-202 kubenswrapper[2576]: E0729 20:09:32.618635    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548\": container with ID starting with 2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548 not found: ID does not exist" containerID="2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548"
Jul 29 20:09:32.618704 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.618656    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548"} err="failed to get container status \"2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548\": rpc error: code = NotFound desc = could not find container \"2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548\": container with ID starting with 2d97b73ca5cb52fb3b13aead2e73f5ac32be13e034df3f7a81973dd2ffd25548 not found: ID does not exist"
Jul 29 20:09:32.622760 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.622731    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"]
Jul 29 20:09:32.626151 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.626124    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-8ef216-openshift-default-5dfdfd99dd-5l7gv"]
Jul 29 20:09:32.642195 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642160    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-podinfo\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.642195 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642191    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-workload-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.642195 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642203    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istiod-ca-cert\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.642386 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642213    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-data\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.642386 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642220    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-envoy\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.642386 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642230    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md5bc\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-kube-api-access-md5bc\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.642386 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642238    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e229bc-d651-4ce3-9a29-30ab7ef94f95-credential-socket\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.642386 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.642246    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e229bc-d651-4ce3-9a29-30ab7ef94f95-istio-token\") on node \"ip-10-0-131-202.ec2.internal\" DevicePath \"\""
Jul 29 20:09:32.714840 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:32.714806    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" path="/var/lib/kubelet/pods/18e229bc-d651-4ce3-9a29-30ab7ef94f95/volumes"
Jul 29 20:09:33.672986 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:33.672956    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6979b57c55-6569p_52198945-11c8-45f3-85be-af604b5b938f/manager/0.log"
Jul 29 20:09:34.137619 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:34.137595    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-sdqjj_392dd391-f6b6-43da-b3ae-4d7576f1694f/copy-manifests/0.log"
Jul 29 20:09:34.149865 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:34.149815    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-sdqjj_392dd391-f6b6-43da-b3ae-4d7576f1694f/manager/0.log"
Jul 29 20:09:34.610500 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:34.610462    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-745dff79d8-49d8p_a1d8d406-cff9-4a09-8771-195300952f33/maas-api/0.log"
Jul 29 20:09:34.725978 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:34.725947    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755890-rlzvb_05457c24-2578-4d17-ae06-64190f7664e2/cleanup/0.log"
Jul 29 20:09:34.832958 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:34.832931    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755905-nrb8d_5108c1e0-69c0-472a-89aa-37ebe248d130/cleanup/0.log"
Jul 29 20:09:34.941962 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:34.941886    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755920-8g475_f092a80a-5ab4-4821-a250-611ca0d60fdc/cleanup/0.log"
Jul 29 20:09:35.852671 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:35.852643    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9_b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c/extract/0.log"
Jul 29 20:09:35.858892 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:35.858867    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9_b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c/util/0.log"
Jul 29 20:09:35.865248 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:35.865224    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9_b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c/pull/0.log"
Jul 29 20:09:35.974027 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:35.974001    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2_92002c08-7a73-42c7-8b87-a93283a40964/extract/0.log"
Jul 29 20:09:35.979987 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:35.979964    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2_92002c08-7a73-42c7-8b87-a93283a40964/util/0.log"
Jul 29 20:09:35.986034 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:35.986011    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2_92002c08-7a73-42c7-8b87-a93283a40964/pull/0.log"
Jul 29 20:09:36.096424 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:36.096396    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk_3b7534e7-8ea5-4803-b721-7c8c5ba38df3/util/0.log"
Jul 29 20:09:36.102590 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:36.102561    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk_3b7534e7-8ea5-4803-b721-7c8c5ba38df3/pull/0.log"
Jul 29 20:09:36.108585 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:36.108511    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk_3b7534e7-8ea5-4803-b721-7c8c5ba38df3/extract/0.log"
Jul 29 20:09:36.217799 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:36.217763    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk_1d30499b-d13f-4f8f-89d9-e14d56fcee4b/util/0.log"
Jul 29 20:09:36.223799 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:36.223776    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk_1d30499b-d13f-4f8f-89d9-e14d56fcee4b/pull/0.log"
Jul 29 20:09:36.229503 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:36.229485    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk_1d30499b-d13f-4f8f-89d9-e14d56fcee4b/extract/0.log"
Jul 29 20:09:37.185422 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:37.185385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ds8nd_48179430-6867-4c81-8e9a-1309ac0b0ca3/manager/0.log"
Jul 29 20:09:37.652142 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:37.652108    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6hl27_eab1a1e6-cd12-42c9-9218-5ca13216d26a/discovery/0.log"
Jul 29 20:09:38.098431 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:38.098398    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wjddx_465c62ff-5ab4-4c1c-8c15-f49640ed3c91/payload-pre-processing/0.log"
Jul 29 20:09:38.700780 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:38.700752    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qdxtb_139513b7-0b90-46db-8a58-76def07064b5/main/0.log"
Jul 29 20:09:39.030986 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:39.030953    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwb94m_152467ff-c9c6-481e-a328-feec411fef94/main/0.log"
Jul 29 20:09:44.756565 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756506    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x7qkh/must-gather-856vh"]
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756851    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756864    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756874    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756889    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756902    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756908    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756914    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3db9872-9e1d-4cfb-b680-fd11556213d7" containerName="revoke-keys"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756920    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3db9872-9e1d-4cfb-b680-fd11556213d7" containerName="revoke-keys"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756930    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756936    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756946    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy"
Jul 29 20:09:44.756949 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756951    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc87fa11-4006-4b14-9087-bc153cff2e3c" containerName="istio-proxy"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756961    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c052fc24-dbf6-4833-aa0f-609226986e7a" containerName="maas-api"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756967    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c052fc24-dbf6-4833-aa0f-609226986e7a" containerName="maas-api"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756989    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38999cd4-0508-43df-a6c9-cf9823b7d09b" containerName="maas-api"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.756994    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="38999cd4-0508-43df-a6c9-cf9823b7d09b" containerName="maas-api"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.757047    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.757054    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3db9872-9e1d-4cfb-b680-fd11556213d7" containerName="revoke-keys"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.757061    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.757067    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c052fc24-dbf6-4833-aa0f-609226986e7a" containerName="maas-api"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.757071    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="38999cd4-0508-43df-a6c9-cf9823b7d09b" containerName="maas-api"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.757080    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="263bbd28-08e2-4f72-b895-ed4b12288830" containerName="istio-proxy"
Jul 29 20:09:44.757314 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.757086    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e229bc-d651-4ce3-9a29-30ab7ef94f95" containerName="istio-proxy"
Jul 29 20:09:44.761948 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.761926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:44.765989 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.765968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x7qkh\"/\"default-dockercfg-t7j52\""
Jul 29 20:09:44.766865 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.766834    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7qkh\"/\"openshift-service-ca.crt\""
Jul 29 20:09:44.767119 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.767100    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7qkh\"/\"kube-root-ca.crt\""
Jul 29 20:09:44.769938 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.769919    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/must-gather-856vh"]
Jul 29 20:09:44.771850 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.771825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:44.845342 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.845309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wp8p\" (UniqueName: \"kubernetes.io/projected/5d6c7e64-ae82-44e4-8ed8-84ae649cefb1-kube-api-access-8wp8p\") pod \"must-gather-856vh\" (UID: \"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1\") " pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:44.845510 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.845361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5d6c7e64-ae82-44e4-8ed8-84ae649cefb1-must-gather-output\") pod \"must-gather-856vh\" (UID: \"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1\") " pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:44.874417 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.874372    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:09:44.946749 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.946714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5d6c7e64-ae82-44e4-8ed8-84ae649cefb1-must-gather-output\") pod \"must-gather-856vh\" (UID: \"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1\") " pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:44.946929 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.946814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wp8p\" (UniqueName: \"kubernetes.io/projected/5d6c7e64-ae82-44e4-8ed8-84ae649cefb1-kube-api-access-8wp8p\") pod \"must-gather-856vh\" (UID: \"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1\") " pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:44.947066 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.947047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5d6c7e64-ae82-44e4-8ed8-84ae649cefb1-must-gather-output\") pod \"must-gather-856vh\" (UID: \"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1\") " pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:44.954332 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:44.954302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wp8p\" (UniqueName: \"kubernetes.io/projected/5d6c7e64-ae82-44e4-8ed8-84ae649cefb1-kube-api-access-8wp8p\") pod \"must-gather-856vh\" (UID: \"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1\") " pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:45.071666 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:45.071540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/must-gather-856vh"
Jul 29 20:09:45.209346 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:45.209317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/must-gather-856vh"]
Jul 29 20:09:45.210964 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:09:45.210934    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d6c7e64_ae82_44e4_8ed8_84ae649cefb1.slice/crio-940cdfc7869bce6711ba32b0087a38831b395c71ba06ba14ac57e4e43cf8ee1b WatchSource:0}: Error finding container 940cdfc7869bce6711ba32b0087a38831b395c71ba06ba14ac57e4e43cf8ee1b: Status 404 returned error can't find the container with id 940cdfc7869bce6711ba32b0087a38831b395c71ba06ba14ac57e4e43cf8ee1b
Jul 29 20:09:45.673605 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:45.673569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/must-gather-856vh" event={"ID":"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1","Type":"ContainerStarted","Data":"940cdfc7869bce6711ba32b0087a38831b395c71ba06ba14ac57e4e43cf8ee1b"}
Jul 29 20:09:46.682256 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:46.682215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/must-gather-856vh" event={"ID":"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1","Type":"ContainerStarted","Data":"a70efa2cda2c4f7ca87482dbfee8d8e1ea23e06fedd7ddc182bfc4e1ec982c42"}
Jul 29 20:09:46.682708 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:46.682271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/must-gather-856vh" event={"ID":"5d6c7e64-ae82-44e4-8ed8-84ae649cefb1","Type":"ContainerStarted","Data":"b9548f32ac7c45f790ea881680d3f1143db1b42a8638c63caee43a1c951037f0"}
Jul 29 20:09:46.699270 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:46.699201    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x7qkh/must-gather-856vh" podStartSLOduration=1.698305356 podStartE2EDuration="2.699179474s" totalImagesPullingTime="1.000874118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:46.695985309 +0000 UTC m=+3280.591802577" watchObservedRunningTime="2026-07-29 20:09:46.699179474 +0000 UTC m=+3280.594996742"
Jul 29 20:09:47.891756 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:47.891719    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kklpt_27ed65c4-fe8d-4a3d-986b-8fb9986e86db/global-pull-secret-syncer/0.log"
Jul 29 20:09:47.980729 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:47.980696    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log"
Jul 29 20:09:48.103813 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:48.103780    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-202.ec2.internal_1b997b5b4f9231c7f1b31583b88bf7d6/haproxy/0.log"
Jul 29 20:09:52.030885 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.030842    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9_b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c/extract/0.log"
Jul 29 20:09:52.053725 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.053698    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9_b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c/util/0.log"
Jul 29 20:09:52.081881 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.081853    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75956cj9_b16ee2f4-9daa-4a58-a165-ff5ce1c64f8c/pull/0.log"
Jul 29 20:09:52.112204 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.112144    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2_92002c08-7a73-42c7-8b87-a93283a40964/extract/0.log"
Jul 29 20:09:52.139766 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.139575    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2_92002c08-7a73-42c7-8b87-a93283a40964/util/0.log"
Jul 29 20:09:52.165891 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.165849    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv8v2_92002c08-7a73-42c7-8b87-a93283a40964/pull/0.log"
Jul 29 20:09:52.206393 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.206368    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk_3b7534e7-8ea5-4803-b721-7c8c5ba38df3/extract/0.log"
Jul 29 20:09:52.236779 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.236693    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk_3b7534e7-8ea5-4803-b721-7c8c5ba38df3/util/0.log"
Jul 29 20:09:52.264501 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.264406    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wdgk_3b7534e7-8ea5-4803-b721-7c8c5ba38df3/pull/0.log"
Jul 29 20:09:52.308749 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.308621    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk_1d30499b-d13f-4f8f-89d9-e14d56fcee4b/extract/0.log"
Jul 29 20:09:52.335461 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.335427    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk_1d30499b-d13f-4f8f-89d9-e14d56fcee4b/util/0.log"
Jul 29 20:09:52.359534 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:52.359500    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bsvbk_1d30499b-d13f-4f8f-89d9-e14d56fcee4b/pull/0.log"
Jul 29 20:09:53.326567 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:53.325844    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ds8nd_48179430-6867-4c81-8e9a-1309ac0b0ca3/manager/0.log"
Jul 29 20:09:55.243262 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.243211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-mj9f8_2814ee5d-1ec3-46d9-aa08-20ed5f5958ee/monitoring-plugin/0.log"
Jul 29 20:09:55.462409 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.462266    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2l6d_6da44898-0c22-429a-8b19-ec85b783d0b8/node-exporter/0.log"
Jul 29 20:09:55.488972 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.488780    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2l6d_6da44898-0c22-429a-8b19-ec85b783d0b8/kube-rbac-proxy/0.log"
Jul 29 20:09:55.514403 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.514288    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2l6d_6da44898-0c22-429a-8b19-ec85b783d0b8/init-textfile/0.log"
Jul 29 20:09:55.544351 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.544322    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6vbqc_6acc4872-8096-44fd-9255-0c07cbfb6738/kube-rbac-proxy-main/0.log"
Jul 29 20:09:55.566237 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.566211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6vbqc_6acc4872-8096-44fd-9255-0c07cbfb6738/kube-rbac-proxy-self/0.log"
Jul 29 20:09:55.587658 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.587629    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6vbqc_6acc4872-8096-44fd-9255-0c07cbfb6738/openshift-state-metrics/0.log"
Jul 29 20:09:55.959014 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.958985    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c9d59bd44-sz8zm_b7d5b195-e410-44f0-a478-6b7bee588676/thanos-query/0.log"
Jul 29 20:09:55.989036 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:55.989009    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c9d59bd44-sz8zm_b7d5b195-e410-44f0-a478-6b7bee588676/kube-rbac-proxy-web/0.log"
Jul 29 20:09:56.012318 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:56.012278    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c9d59bd44-sz8zm_b7d5b195-e410-44f0-a478-6b7bee588676/kube-rbac-proxy/0.log"
Jul 29 20:09:56.032371 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:56.032338    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c9d59bd44-sz8zm_b7d5b195-e410-44f0-a478-6b7bee588676/prom-label-proxy/0.log"
Jul 29 20:09:56.053721 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:56.053691    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c9d59bd44-sz8zm_b7d5b195-e410-44f0-a478-6b7bee588676/kube-rbac-proxy-rules/0.log"
Jul 29 20:09:56.074943 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:56.074899    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c9d59bd44-sz8zm_b7d5b195-e410-44f0-a478-6b7bee588676/kube-rbac-proxy-metrics/0.log"
Jul 29 20:09:58.133887 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.133845    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"]
Jul 29 20:09:58.142147 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.142071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.148372 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.148341    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"]
Jul 29 20:09:58.182406 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.180215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-sys\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.182406 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.180298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-podres\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.182406 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.180346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhtxz\" (UniqueName: \"kubernetes.io/projected/3521d024-2266-48a9-be64-776f0bfb5ca6-kube-api-access-qhtxz\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.182406 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.180411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-lib-modules\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.182406 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.180447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-proc\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281004 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.280963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-podres\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281192 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhtxz\" (UniqueName: \"kubernetes.io/projected/3521d024-2266-48a9-be64-776f0bfb5ca6-kube-api-access-qhtxz\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281192 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-lib-modules\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281192 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-proc\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281192 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-sys\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281415 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-sys\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281415 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-podres\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281708 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281679    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-proc\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.281843 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.281712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3521d024-2266-48a9-be64-776f0bfb5ca6-lib-modules\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.289767 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.289738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhtxz\" (UniqueName: \"kubernetes.io/projected/3521d024-2266-48a9-be64-776f0bfb5ca6-kube-api-access-qhtxz\") pod \"perf-node-gather-daemonset-vhtbn\" (UID: \"3521d024-2266-48a9-be64-776f0bfb5ca6\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.455817 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.455726    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.674075 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.674045    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"]
Jul 29 20:09:58.676943 ip-10-0-131-202 kubenswrapper[2576]: W0729 20:09:58.676914    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3521d024_2266_48a9_be64_776f0bfb5ca6.slice/crio-6c8d6c5c377ef3ed443a64ac134ab2a9c53eb003f8c853c66f01cc3b067ffd18 WatchSource:0}: Error finding container 6c8d6c5c377ef3ed443a64ac134ab2a9c53eb003f8c853c66f01cc3b067ffd18: Status 404 returned error can't find the container with id 6c8d6c5c377ef3ed443a64ac134ab2a9c53eb003f8c853c66f01cc3b067ffd18
Jul 29 20:09:58.777211 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.777173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn" event={"ID":"3521d024-2266-48a9-be64-776f0bfb5ca6","Type":"ContainerStarted","Data":"54c46f85e3133d3e3277b454790ef2d05a88bf5bd37d537ca57f9b5f8634cee5"}
Jul 29 20:09:58.777415 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.777228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn" event={"ID":"3521d024-2266-48a9-be64-776f0bfb5ca6","Type":"ContainerStarted","Data":"6c8d6c5c377ef3ed443a64ac134ab2a9c53eb003f8c853c66f01cc3b067ffd18"}
Jul 29 20:09:58.777415 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.777366    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:09:58.791849 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:09:58.791788    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn" podStartSLOduration=0.791766101 podStartE2EDuration="791.766101ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:58.791008289 +0000 UTC m=+3292.686825570" watchObservedRunningTime="2026-07-29 20:09:58.791766101 +0000 UTC m=+3292.687583372"
Jul 29 20:10:00.205854 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:00.205826    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gmh97_6aac30ac-b63d-4411-9c11-6564aa6b15a0/dns/0.log"
Jul 29 20:10:00.227489 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:00.227458    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gmh97_6aac30ac-b63d-4411-9c11-6564aa6b15a0/kube-rbac-proxy/0.log"
Jul 29 20:10:00.357592 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:00.357554    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59448_3a9351cd-2561-46a6-8474-80f9f6321b66/dns-node-resolver/0.log"
Jul 29 20:10:00.963586 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:00.963528    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76ff66c997-hmtbf_41866977-9a3b-472d-9b20-1092eb4f0976/registry/0.log"
Jul 29 20:10:01.036516 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:01.036488    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xthj6_fd97036a-5a5b-44cd-826a-0ccfd261f490/node-ca/0.log"
Jul 29 20:10:02.141490 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:02.141457    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6hl27_eab1a1e6-cd12-42c9-9218-5ca13216d26a/discovery/0.log"
Jul 29 20:10:02.302129 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:02.302098    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wjddx_465c62ff-5ab4-4c1c-8c15-f49640ed3c91/payload-pre-processing/0.log"
Jul 29 20:10:03.232001 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:03.231971    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zbbtz_da689ff5-458d-4265-8b27-d217b252f2e4/serve-healthcheck-canary/0.log"
Jul 29 20:10:03.730719 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:03.730688    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6l97r_05507663-503c-4ec6-a483-4552ea884eb8/kube-rbac-proxy/0.log"
Jul 29 20:10:03.752423 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:03.752387    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6l97r_05507663-503c-4ec6-a483-4552ea884eb8/exporter/0.log"
Jul 29 20:10:03.775962 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:03.775933    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6l97r_05507663-503c-4ec6-a483-4552ea884eb8/extractor/0.log"
Jul 29 20:10:04.793573 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:04.793532    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-vhtbn"
Jul 29 20:10:06.663566 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:06.662175    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6979b57c55-6569p_52198945-11c8-45f3-85be-af604b5b938f/manager/0.log"
Jul 29 20:10:06.996510 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:06.996073    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-sdqjj_392dd391-f6b6-43da-b3ae-4d7576f1694f/manager/0.log"
Jul 29 20:10:07.016180 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:07.016081    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-sdqjj_392dd391-f6b6-43da-b3ae-4d7576f1694f/copy-manifests/0.log"
Jul 29 20:10:07.147941 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:07.147908    2576 scope.go:117] "RemoveContainer" containerID="7ac1914522cce4b653bdeddd5c0c2d0daa816608f6a904a087ce4818c839a680"
Jul 29 20:10:07.161186 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:07.161158    2576 scope.go:117] "RemoveContainer" containerID="4eb58cf8f02735cb3bc063c985077be8569fe6677031254422a965abcd1bfbb5"
Jul 29 20:10:08.581019 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:08.580979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66ff6dc8fc-96g8r_3c0fdf74-5883-4a25-aa5e-6055d92daeec/manager/0.log"
Jul 29 20:10:08.888899 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:08.888856    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6hl27_eab1a1e6-cd12-42c9-9218-5ca13216d26a/discovery/0.log"
Jul 29 20:10:09.017102 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:09.017069    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wjddx_465c62ff-5ab4-4c1c-8c15-f49640ed3c91/payload-pre-processing/0.log"
Jul 29 20:10:10.686956 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:10.686915    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6hl27_eab1a1e6-cd12-42c9-9218-5ca13216d26a/discovery/0.log"
Jul 29 20:10:10.821934 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:10.821894    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wjddx_465c62ff-5ab4-4c1c-8c15-f49640ed3c91/payload-pre-processing/0.log"
Jul 29 20:10:13.820929 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:13.820868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnkr5_1e6d0fd0-fab0-4849-b7cc-7f1ad0a1b7c7/konnectivity-agent/0.log" limit=1024
Jul 29 20:10:15.162002 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.161977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6xrl_60a484a0-1132-4a26-96f6-3d86d734fc01/kube-multus-additional-cni-plugins/0.log"
Jul 29 20:10:15.184396 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.184368    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6xrl_60a484a0-1132-4a26-96f6-3d86d734fc01/egress-router-binary-copy/0.log"
Jul 29 20:10:15.206873 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.206847    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6xrl_60a484a0-1132-4a26-96f6-3d86d734fc01/cni-plugins/0.log"
Jul 29 20:10:15.228567 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.228515    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6xrl_60a484a0-1132-4a26-96f6-3d86d734fc01/bond-cni-plugin/0.log"
Jul 29 20:10:15.250033 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.249992    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6xrl_60a484a0-1132-4a26-96f6-3d86d734fc01/routeoverride-cni/0.log"
Jul 29 20:10:15.274615 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.274583    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6xrl_60a484a0-1132-4a26-96f6-3d86d734fc01/whereabouts-cni-bincopy/0.log"
Jul 29 20:10:15.296126 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.296093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6xrl_60a484a0-1132-4a26-96f6-3d86d734fc01/whereabouts-cni/0.log"
Jul 29 20:10:15.511433 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.511401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cdzsp_a52d02c4-047b-413d-8c82-c6435ccb4744/kube-multus/0.log"
Jul 29 20:10:15.625570 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.625481    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bqgqz_8f310751-a3b2-414d-aa3e-5c886331cdc6/network-metrics-daemon/0.log"
Jul 29 20:10:15.645407 ip-10-0-131-202 kubenswrapper[2576]: I0729 20:10:15.645369    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bqgqz_8f310751-a3b2-414d-aa3e-5c886331cdc6/kube-rbac-proxy/0.log"