Jul 28 20:43:12.678702 ip-10-0-133-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 20:43:12.678713 ip-10-0-133-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 20:43:12.678720 ip-10-0-133-57 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 20:43:12.678939 ip-10-0-133-57 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 20:43:22.858741 ip-10-0-133-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 20:43:22.858756 ip-10-0-133-57 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a534ae7c74934449b29d991356bdbdec --
Jul 28 20:44:55.034114 ip-10-0-133-57 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 20:44:55.491903 ip-10-0-133-57 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:44:55.491903 ip-10-0-133-57 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 20:44:55.491903 ip-10-0-133-57 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:44:55.491903 ip-10-0-133-57 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 20:44:55.491903 ip-10-0-133-57 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:44:55.493140 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.492957    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502002    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502028    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502032    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502035    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502038    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502041    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502043    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502046    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502048    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:44:55.502037 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502051    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502054    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502057    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502059    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502062    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502066    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502070    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502073    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502075    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502078    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502082    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502086    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502088    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502091    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502093    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502096    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502098    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502100    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502103    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:44:55.502376 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502108    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502111    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502113    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502116    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502119    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502121    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502124    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502127    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502130    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502132    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502135    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502137    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502140    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502142    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502145    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502148    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502151    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502154    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502156    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502159    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:44:55.502867 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502161    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502164    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502167    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502170    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502172    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502175    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502177    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502179    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502182    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502184    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502187    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502189    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502191    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502194    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502196    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502198    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502201    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502203    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502205    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502208    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:44:55.503362 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502210    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502213    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502215    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502217    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502219    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502222    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502224    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502228    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502230    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502233    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502236    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502240    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502242    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502244    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502247    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502250    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502252    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502254    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502257    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502260    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:44:55.503868 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502262    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502264    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502268    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502270    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502272    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502275    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502277    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502281    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502284    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502286    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.502290    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503028    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503035    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503038    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503041    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503043    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503046    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503049    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503052    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:44:55.504355 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503057    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503059    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503062    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503065    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503067    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503070    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503073    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503075    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503078    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503081    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503084    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503087    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503089    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503092    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503094    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503099    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503103    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503106    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503108    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:44:55.504846 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503111    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503114    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503117    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503120    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503123    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503126    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503129    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503132    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503134    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503137    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503139    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503142    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503144    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503148    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503151    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503154    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503157    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503159    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503162    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503164    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:44:55.505329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503167    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503170    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503173    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503177    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503179    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503182    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503184    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503187    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503190    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503192    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503195    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503198    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503201    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503204    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503206    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503210    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503214    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503217    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503220    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:44:55.505835 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503223    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503226    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503229    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503231    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503235    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503238    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503241    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503244    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503247    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503249    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503252    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503254    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503257    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503260    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503262    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503264    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503267    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503276    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503279    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503282    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:44:55.506316 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503285    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503288    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503290    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503293    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503296    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503298    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503301    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503303    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503306    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503308    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503311    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503313    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503316    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503738    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503743    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503746    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503749    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503752    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503754    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503757    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:44:55.506834 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503760    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503763    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503765    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503768    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503771    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503773    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503796    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503799    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503802    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503805    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503808    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503810    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503813    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503816    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503819    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503822    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503825    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503827    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503829    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503832    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:44:55.507329 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503835    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503837    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503840    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503842    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503846    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503848    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503852    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503856    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503859    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503862    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503865    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503868    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503871    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503875    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503877    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503880    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503884    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503887    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503891    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:44:55.507885 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503893    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503896    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503898    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503902    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503904    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503907    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503910    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503912    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503915    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503917    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503919    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503922    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503924    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503927    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503929    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503932    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503934    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503938    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503941    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:44:55.508360 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503944    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503947    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503949    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503952    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503956    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503958    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503960    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503963    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503965    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503968    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503970    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503972    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503977    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503980    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503982    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503985    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503987    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503993    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503996    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.503999    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:44:55.508878 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504001    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504003    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504006    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504009    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504011    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504014    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504016    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504018    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504021    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504023    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504025    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504027    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504030    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504032    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504109    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504123    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504130    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504134    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504139    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504142    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504147    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 20:44:55.509361 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504152    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504155    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504158    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504162    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504165    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504168    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504171    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504174    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504177    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504183    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504186    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504193    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504195    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504199    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504202    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504205    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504209    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504212    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504215    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504219    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504222    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504225    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504228    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504231    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 20:44:55.509898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504234    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504238    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504241    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504244    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504246    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504249    2572 flags.go:64] FLAG: --enable-server="true"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504252    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504257    2572 flags.go:64] FLAG: --event-burst="100"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504260    2572 flags.go:64] FLAG: --event-qps="50"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504262    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504265    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504268    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504272    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504276    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504279    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504281    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504284    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504287    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504290    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504293    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504296    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504299    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504302    2572 flags.go:64] FLAG: --feature-gates=""
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504305    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504308    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 20:44:55.510485 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504311    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504314    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504317    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504320    2572 flags.go:64] FLAG: --help="false"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504323    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504326    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504329    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504331    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504335    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504338    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504341    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504344    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504346    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504349    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504352    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504355    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504357    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504360    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504365    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504368    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504371    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504374    2572 flags.go:64] FLAG: --lock-file=""
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504377    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504380    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 20:44:55.511138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504383    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504388    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504392    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504395    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504397    2572 flags.go:64] FLAG: --logging-format="text"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504400    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504404    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504406    2572 flags.go:64] FLAG: --manifest-url=""
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504409    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504413    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504419    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504423    2572 flags.go:64] FLAG: --max-pods="110"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504426    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504429    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504431    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504434    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504437    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504440    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504443    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504450    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504453    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504456    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504459    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 28 20:44:55.512162 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504462    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504468    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504470    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504474    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504477    2572 flags.go:64] FLAG: --port="10250"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504480    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504483    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eccf688503643977"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504486    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504489    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504492    2572 flags.go:64] FLAG: --register-node="true"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504495    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504498    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504502    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504504    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504507    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504511    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504514    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504517    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504520    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504523    2572 flags.go:64] FLAG: --runonce="false"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504528    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504530    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504533    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504536    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504539    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504542    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 20:44:55.513179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504544    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504547    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504550    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504553    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504555    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504558    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504561    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504564    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504566    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504573    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504576    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504579    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504582    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504585    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504588    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504591    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504593    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504596    2572 flags.go:64] FLAG: --v="2"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504600    2572 flags.go:64] FLAG: --version="false"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504609    2572 flags.go:64] FLAG: --vmodule=""
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504612    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.504615    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504768    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504772    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:44:55.514384 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504790    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504794    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504799    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504813    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504816    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504819    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504822    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504824    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504827    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504830    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504832    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504835    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504837    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504840    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504842    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504845    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504849    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504854    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504858    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:44:55.515471 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504861    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504864    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504867    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504869    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504872    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504874    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504877    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504879    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504882    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504885    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504888    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504890    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504893    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504896    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504898    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504903    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504905    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504908    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504911    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504913    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:44:55.516228 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504916    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504919    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504921    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504923    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504926    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504928    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504931    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504933    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504936    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504939    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504941    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504945    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504948    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504950    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504953    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504955    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504958    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504960    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504963    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504965    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:44:55.516758 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504968    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504970    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504979    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504982    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504984    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504987    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504989    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504993    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504996    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.504999    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505001    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505005    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505008    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505012    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505015    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505018    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505021    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505023    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505026    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:44:55.517604 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505028    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505031    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505033    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505035    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505039    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505041    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505044    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505046    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505049    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505052    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505054    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505056    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505059    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505061    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505064    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505066    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505075    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505078    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:44:55.518457 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.505080    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.505085    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.514305    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.514340    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.514370    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.514379    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514485    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514494    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514499    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514503    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514508    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514513    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514517    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514522    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514527    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:44:55.518950 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514532    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514538    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514544    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514549    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514554    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514558    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514563    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514567    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514572    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514578    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514584    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514589    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514593    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514597    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514601    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514605    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514609    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514614    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:44:55.519455 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514618    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514622    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514630    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514634    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514639    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514643    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514647    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514652    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514656    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514660    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514664    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514679    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514684    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514688    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514692    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514696    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514700    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514704    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514709    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514713    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:44:55.519923 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514717    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514721    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514726    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514730    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514734    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514739    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514743    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514747    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514751    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514755    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514759    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514763    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514767    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514771    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514797    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514803    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514808    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514812    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514816    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514821    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:44:55.520426 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514825    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514855    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514862    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514868    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514872    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514877    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514881    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514885    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514889    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514894    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514900    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514907    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514912    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514917    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514922    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514926    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514931    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514935    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514939    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:44:55.521063 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514944    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514948    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514952    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514956    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514960    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514964    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514968    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514973    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514977    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514983    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514987    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514993    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.514997    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.515005    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515228    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:44:55.521533 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515239    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515245    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515249    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515254    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515259    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515263    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515268    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515272    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515277    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515281    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515285    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515289    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515294    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515298    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515303    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515307    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515311    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515316    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515320    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515324    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:44:55.522062 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515328    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515332    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515336    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515340    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515344    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515350    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515354    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515359    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515363    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515368    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515372    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515376    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515380    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515384    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515388    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515392    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515397    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515401    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515405    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515409    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:44:55.522558 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515413    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515419    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515425    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515429    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515433    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515438    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515442    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515447    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515451    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515455    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515459    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515463    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515467    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515471    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515475    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515479    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515483    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515487    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515490    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:44:55.523108 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515494    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515500    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515504    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515508    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515512    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515516    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515520    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515524    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515529    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515533    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515537    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515541    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515546    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515550    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515554    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515558    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515562    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515566    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515574    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515581    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:44:55.523639 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515587    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515591    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515596    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515600    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515604    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515608    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515612    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515617    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515621    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515625    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515629    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515633    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515637    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515642    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515649    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515653    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515658    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515662    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:44:55.524461 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:55.515666    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:44:55.525193 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.515674    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:44:55.525193 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.515895    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 20:44:55.525193 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.519028    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 20:44:55.525193 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.520879    2572 server.go:1019] "Starting client certificate rotation"
Jul 28 20:44:55.525193 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.520992    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:44:55.525193 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.521038    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:44:55.525193 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.524169    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:44:55.531090 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.531064    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:44:55.539754 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.539731    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 28 20:44:55.542391 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.542367    2572 log.go:25] "Validated CRI v1 image API"
Jul 28 20:44:55.546188 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.546155    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 20:44:55.549875 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.549848    2572 fs.go:135] Filesystem UUIDs: map[3fcadc47-63c8-401a-b69e-0b1e439a280e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bfdd91ba-2e57-4224-9c2a-5128ce37a806:/dev/nvme0n1p4]
Jul 28 20:44:55.549971 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.549876    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 20:44:55.554684 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.554542    2572 manager.go:216] Machine: {Timestamp:2026-07-28 20:44:55.554040492 +0000 UTC m=+0.388284069 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094252 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a75b30ae6cd2d6ea2083dd9503057 SystemUUID:ec2a75b3-0ae6-cd2d-6ea2-083dd9503057 BootID:a534ae7c-7493-4449-b29d-991356bdbdec Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:25:59:54:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:25:59:54:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:02:85:d2:a5:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 20:44:55.554684 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.554659    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 20:44:55.554874 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.554756    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 20:44:55.558318 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.558275    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 20:44:55.558502 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.558326    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 20:44:55.559185 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.559167    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:44:55.559890 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.559876    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 20:44:55.559942 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.559893    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 20:44:55.559942 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.559902    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:44:55.560588 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.560574    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:44:55.561884 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.561872    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 20:44:55.564880 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.564865    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:44:55.565027 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565017    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 20:44:55.565065 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565050    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 20:44:55.565065 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565060    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 20:44:55.565121 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565080    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 20:44:55.565121 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565091    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 28 20:44:55.565121 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565102    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 20:44:55.565493 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565481    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:44:55.565536 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.565499    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:44:55.567948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.567932    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 20:44:55.570334 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.570315    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 20:44:55.570431 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.570358    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 20:44:55.572345 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572331    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572350    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572357    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572362    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572370    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572376    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572384    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572389    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 20:44:55.572395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572395    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 20:44:55.572606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572400    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 20:44:55.572606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572408    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 20:44:55.572606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572413    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 20:44:55.572606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572435    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 20:44:55.572606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.572439    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 20:44:55.576032 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.576013    2572 server.go:1268] "Started kubelet"
Jul 28 20:44:55.576391 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.576365    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 20:44:55.576438 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.576412    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 20:44:55.576726 ip-10-0-133-57 systemd[1]: Started Kubernetes Kubelet.
Jul 28 20:44:55.582353 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.582323    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 20:44:55.582542 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.582499    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 20:44:55.584857 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.584720    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 20:44:55.585148 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.585127    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 20:44:55.585553 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.585530    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 20:44:55.592959 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.592924    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 20:44:55.592959 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.592927    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 20:44:55.593902 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.592737    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef7696fda35  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.575984693 +0000 UTC m=+0.410228272,LastTimestamp:2026-07-28 20:44:55.575984693 +0000 UTC m=+0.410228272,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.601631 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.601613    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 20:44:55.601716 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.601636    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 20:44:55.601766 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.601751    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:55.602526 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602505    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 20:44:55.602526 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602505    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 20:44:55.602642 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602539    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 20:44:55.602642 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602617    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 20:44:55.602642 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602626    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 20:44:55.602817 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602797    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 20:44:55.602885 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602819    2572 factory.go:55] Registering systemd factory
Jul 28 20:44:55.602885 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.602828    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 28 20:44:55.603066 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.603044    2572 factory.go:153] Registering CRI-O factory
Jul 28 20:44:55.603066 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.603058    2572 factory.go:223] Registration of the crio container factory successfully
Jul 28 20:44:55.603165 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.603083    2572 factory.go:103] Registering Raw factory
Jul 28 20:44:55.603165 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.603099    2572 manager.go:1196] Started watching for new ooms in manager
Jul 28 20:44:55.603620 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.603607    2572 manager.go:349] Starting recovery of all containers
Jul 28 20:44:55.604425 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.604399    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 20:44:55.604621 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.604591    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 20:44:55.613383 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.613356    2572 manager.go:354] Recovery completed
Jul 28 20:44:55.617333 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.617316    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:44:55.619629 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.619486    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:44:55.619751 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.619650    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:44:55.619751 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.619665    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:44:55.620315 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.620300    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 20:44:55.620315 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.620313    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 20:44:55.620431 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.620328    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:44:55.620431 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.620354    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:44:55.621057 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.621042    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:44:55.621106 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.621072    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:44:55.621106 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.621082    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:44:55.623007 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.622995    2572 policy_none.go:49] "None policy: Start"
Jul 28 20:44:55.623049 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.623011    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 20:44:55.623049 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.623021    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 20:44:55.624932 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.624921    2572 policy_none.go:47] "Start"
Jul 28 20:44:55.631455 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.631385    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef76c09d0b1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.619629233 +0000 UTC m=+0.453872814,LastTimestamp:2026-07-28 20:44:55.619629233 +0000 UTC m=+0.453872814,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.635613 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.635541    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef76c0a3cc2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-57.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.619656898 +0000 UTC m=+0.453900477,LastTimestamp:2026-07-28 20:44:55.619656898 +0000 UTC m=+0.453900477,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.639866 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.639794    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef76c0a744b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-57.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.619671115 +0000 UTC m=+0.453914693,LastTimestamp:2026-07-28 20:44:55.619671115 +0000 UTC m=+0.453914693,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.648875 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.648743    2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-57.ec2.internal.18c68ef76c09d0b1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef76c09d0b1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.619629233 +0000 UTC m=+0.453872814,LastTimestamp:2026-07-28 20:44:55.621057428 +0000 UTC m=+0.455301006,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.651404 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.651382    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7mhsq"
Jul 28 20:44:55.651828 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.651742    2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-57.ec2.internal.18c68ef76c0a3cc2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef76c0a3cc2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-57.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.619656898 +0000 UTC m=+0.453900477,LastTimestamp:2026-07-28 20:44:55.621076713 +0000 UTC m=+0.455320290,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.659068 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.658978    2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-57.ec2.internal.18c68ef76c0a744b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef76c0a744b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-57.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.619671115 +0000 UTC m=+0.453914693,LastTimestamp:2026-07-28 20:44:55.621085611 +0000 UTC m=+0.455329187,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.659447 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.659435    2572 manager.go:337] "Starting Device Plugin manager"
Jul 28 20:44:55.659494 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.659470    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 20:44:55.659494 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.659480    2572 server.go:87] "Starting device plugin registration server"
Jul 28 20:44:55.659770 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.659758    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 20:44:55.659886 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.659772    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 20:44:55.660045 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.660027    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 20:44:55.662190 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.660112    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 20:44:55.662190 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.660121    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 20:44:55.662190 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.660604    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 20:44:55.662190 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.660655    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:55.662724 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.662700    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7mhsq"
Jul 28 20:44:55.666350 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.666276    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-57.ec2.internal.18c68ef76e904ae5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-57.ec2.internal,UID:ip-10-0-133-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-133-57.ec2.internal,},FirstTimestamp:2026-07-28 20:44:55.661996773 +0000 UTC m=+0.496240353,LastTimestamp:2026-07-28 20:44:55.661996773 +0000 UTC m=+0.496240353,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-57.ec2.internal,}"
Jul 28 20:44:55.709188 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.709137    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 20:44:55.710569 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.710552    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 20:44:55.710622 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.710590    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 20:44:55.710622 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.710614    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 20:44:55.710724 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.710648    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 20:44:55.715637 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.715614    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 28 20:44:55.760810 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.760718    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:44:55.765207 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.765188    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:44:55.765314 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.765222    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:44:55.765314 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.765234    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:44:55.765314 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.765268    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.781907 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.781883    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.781961 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.781913    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-57.ec2.internal\": node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:55.811114 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.811068    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"]
Jul 28 20:44:55.811274 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.811152    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:44:55.812642 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.812627    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:44:55.812710 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.812655    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:44:55.812710 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.812666    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:44:55.813676 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.813659    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:55.815062 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815049    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:44:55.815178 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815162    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.815211 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815196    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:44:55.815841 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815825    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:44:55.815919 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815855    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:44:55.815919 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815825    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:44:55.815919 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815865    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:44:55.815919 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815880    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:44:55.815919 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.815891    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:44:55.818048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.818034    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.818122 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.818059    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:44:55.818849 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.818833    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:44:55.818946 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.818866    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:44:55.818946 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.818879    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:44:55.841694 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.841658    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-57.ec2.internal\" not found" node="ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.846244 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.846219    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-57.ec2.internal\" not found" node="ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.903756 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.903727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/507b913257a62c292c095cec0ddb2c1c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-57.ec2.internal\" (UID: \"507b913257a62c292c095cec0ddb2c1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.903756 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.903757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a10f0822328051138d7bd1e05813a022-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"a10f0822328051138d7bd1e05813a022\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.903991 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:55.903802    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a10f0822328051138d7bd1e05813a022-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"a10f0822328051138d7bd1e05813a022\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:55.913759 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:55.913736    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.004672 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.004645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/507b913257a62c292c095cec0ddb2c1c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-57.ec2.internal\" (UID: \"507b913257a62c292c095cec0ddb2c1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.004754 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.004676    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a10f0822328051138d7bd1e05813a022-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"a10f0822328051138d7bd1e05813a022\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.004754 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.004695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a10f0822328051138d7bd1e05813a022-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"a10f0822328051138d7bd1e05813a022\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.004860 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.004750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a10f0822328051138d7bd1e05813a022-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"a10f0822328051138d7bd1e05813a022\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.004860 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.004795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a10f0822328051138d7bd1e05813a022-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal\" (UID: \"a10f0822328051138d7bd1e05813a022\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.004860 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.004751    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/507b913257a62c292c095cec0ddb2c1c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-57.ec2.internal\" (UID: \"507b913257a62c292c095cec0ddb2c1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.014815 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.014743    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.115635 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.115607    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.144839 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.144801    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.149960 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.149793    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.216741 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.216694    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.317309 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.317235    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.417896 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.417860    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.518499 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.518466    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.519557 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.519538    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 20:44:56.618722 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.618650    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.644907 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:56.644869    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10f0822328051138d7bd1e05813a022.slice/crio-e03820c982922a283d69938eb555b25d1b8442f67eb0b38ddc20482e98fbe93e WatchSource:0}: Error finding container e03820c982922a283d69938eb555b25d1b8442f67eb0b38ddc20482e98fbe93e: Status 404 returned error can't find the container with id e03820c982922a283d69938eb555b25d1b8442f67eb0b38ddc20482e98fbe93e
Jul 28 20:44:56.650022 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.650003    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:44:56.656829 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:56.656789    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507b913257a62c292c095cec0ddb2c1c.slice/crio-1975991bf99f09c02763d0201b0ab66995614b31ad38882e04215d208312fc33 WatchSource:0}: Error finding container 1975991bf99f09c02763d0201b0ab66995614b31ad38882e04215d208312fc33: Status 404 returned error can't find the container with id 1975991bf99f09c02763d0201b0ab66995614b31ad38882e04215d208312fc33
Jul 28 20:44:56.670411 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.670376    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 20:39:56 +0000 UTC" deadline="2028-02-21 12:00:28.406137632 +0000 UTC"
Jul 28 20:44:56.670411 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.670409    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13743h15m31.735731565s"
Jul 28 20:44:56.714525 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.714465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" event={"ID":"507b913257a62c292c095cec0ddb2c1c","Type":"ContainerStarted","Data":"1975991bf99f09c02763d0201b0ab66995614b31ad38882e04215d208312fc33"}
Jul 28 20:44:56.715644 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.715616    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" event={"ID":"a10f0822328051138d7bd1e05813a022","Type":"ContainerStarted","Data":"e03820c982922a283d69938eb555b25d1b8442f67eb0b38ddc20482e98fbe93e"}
Jul 28 20:44:56.718958 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:56.718938    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-57.ec2.internal\" not found"
Jul 28 20:44:56.729875 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.729853    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:44:56.802623 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.802584    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.820416 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.820389    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:44:56.824113 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.824094    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:44:56.825875 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.825857    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal"
Jul 28 20:44:56.838060 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:56.838035    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:44:57.001025 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.000938    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:44:57.057792 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.057740    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:44:57.567115 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.567040    2572 apiserver.go:52] "Watching apiserver"
Jul 28 20:44:57.577191 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.577159    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 20:44:57.577664 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.577633    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5chvb","kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn","openshift-dns/node-resolver-9nw5c","openshift-image-registry/node-ca-fzprj","openshift-multus/multus-l47wf","openshift-multus/network-metrics-daemon-b6hg6","openshift-network-operator/iptables-alerter-nqw8p","kube-system/konnectivity-agent-584kl","openshift-cluster-node-tuning-operator/tuned-4vmqk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal","openshift-multus/multus-additional-cni-plugins-49799","openshift-network-diagnostics/network-check-target-v7znx","openshift-ovn-kubernetes/ovnkube-node-bfwqf"]
Jul 28 20:44:57.580466 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.580440    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:57.580603 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.580542    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:44:57.583222 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.583196    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:44:57.583339 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.583285    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:44:57.586377 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.586347    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.588715 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.588688    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.589239 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.589213    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 20:44:57.589353 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.589219    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cmx86\""
Jul 28 20:44:57.589417 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.589361    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 20:44:57.589477 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.589446    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 20:44:57.591151 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.591132    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.591517 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.591495    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 20:44:57.591605 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.591529    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 20:44:57.591951 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.591932    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gksv2\""
Jul 28 20:44:57.593716 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.593681    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.597093 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.597073    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.597503 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.597483    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 20:44:57.597733 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.597715    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 20:44:57.597984 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.597969    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 20:44:57.598183 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.598163    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4kx8w\""
Jul 28 20:44:57.598490 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.598472    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 20:44:57.598669 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.598654    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 20:44:57.598968 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.598936    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gn8pp\""
Jul 28 20:44:57.600079 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.600021    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.600187 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.600092    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:44:57.600412 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.600390    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 20:44:57.600556 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.600536    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 20:44:57.600817 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.600790    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7zrfv\""
Jul 28 20:44:57.600994 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.600976    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 20:44:57.601045 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.601033    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 20:44:57.604089 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.604054    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 20:44:57.604089 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.604082    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.607317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.607060    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.607317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.606937    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 20:44:57.608910 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.608435    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 20:44:57.608910 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.608476    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 20:44:57.608910 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.608629    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 20:44:57.608910 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.608802    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cwsxq\""
Jul 28 20:44:57.609684 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.609662    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 20:44:57.609781 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.609691    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 20:44:57.610571 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.610102    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 20:44:57.610571 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.610133    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.610571 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.610271    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:44:57.610806 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.610703    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n9vpq\""
Jul 28 20:44:57.613201 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.613175    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.613309 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.613292    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 20:44:57.613547 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.613531    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:44:57.613982 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.613818    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7m9zj\""
Jul 28 20:44:57.613982 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.613832    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-kubernetes\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615191    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-host\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615216    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615242    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lkcc\" (UniqueName: \"kubernetes.io/projected/2ac58d4c-790e-4d2e-bd81-376067877ce0-kube-api-access-8lkcc\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d52b0f5-195f-4d56-9d01-74af61d80cee-agent-certs\") pod \"konnectivity-agent-584kl\" (UID: \"1d52b0f5-195f-4d56-9d01-74af61d80cee\") " pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvd2m\" (UniqueName: \"kubernetes.io/projected/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-kube-api-access-tvd2m\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615324    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-cni-bin\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.615392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615355    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-cni-netd\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615396    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-registration-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615443    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-device-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615477    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-socket-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615503    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615537    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts752\" (UniqueName: \"kubernetes.io/projected/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-kube-api-access-ts752\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-systemd\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615589    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-log-socket\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovn-node-metrics-cert\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a80e5701-d1ec-4ccb-af02-cab4bde712de-tmp\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-cni-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-env-overrides\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615713    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f87p\" (UniqueName: \"kubernetes.io/projected/a80e5701-d1ec-4ccb-af02-cab4bde712de-kube-api-access-8f87p\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615738    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-os-release\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615763    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-cni-binary-copy\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-socket-dir-parent\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.615871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-k8s-cni-cncf-io\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615867    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-hostroot\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-kubelet\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615918    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-run-netns\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615942    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovnkube-script-lib\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615968    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24d41e59-b89c-4178-91b2-af1dc84e86ed-kubelet-config\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.615992    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24d41e59-b89c-4178-91b2-af1dc84e86ed-dbus\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616015    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-modprobe-d\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616054    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mzh6r\""
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8b4b\" (UniqueName: \"kubernetes.io/projected/78335586-a8b1-475b-b444-f3f5fb9a27bd-kube-api-access-h8b4b\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-cnibin\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-conf-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616136    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvkq6\" (UniqueName: \"kubernetes.io/projected/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-kube-api-access-lvkq6\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616164    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-cni-bin\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616214    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysctl-conf\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-netns\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.616659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616263    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-ovn\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616293    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-systemd\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616316    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616316    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-var-lib-kubelet\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-multus-certs\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-sys\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s45dw\" (UniqueName: \"kubernetes.io/projected/d749b6ec-d33e-4b20-8d22-5f332ac2d721-kube-api-access-s45dw\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-system-cni-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616586    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616589    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-daemon-config\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d52b0f5-195f-4d56-9d01-74af61d80cee-konnectivity-ca\") pod \"konnectivity-agent-584kl\" (UID: \"1d52b0f5-195f-4d56-9d01-74af61d80cee\") " pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-tuned\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-serviceca\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616685    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-sys-fs\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616709    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616761    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616835    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-etc-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovnkube-config\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.616980    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-run\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d749b6ec-d33e-4b20-8d22-5f332ac2d721-tmp-dir\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617028    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-cni-multus\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617053    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-node-log\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-host\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617123    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-kubelet\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617159    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-systemd-units\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysctl-d\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617296    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-lib-modules\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617330    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d749b6ec-d33e-4b20-8d22-5f332ac2d721-hosts-file\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617356    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-etc-kubernetes\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617394    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-slash\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-var-lib-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.617939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.617471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysconfig\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.620076 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.620054    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:44:57.655275 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.655249    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kb2p6"
Jul 28 20:44:57.665089 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.665020    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kb2p6"
Jul 28 20:44:57.703379 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.703346    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 20:44:57.718495 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovnkube-script-lib\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.718670 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718506    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24d41e59-b89c-4178-91b2-af1dc84e86ed-kubelet-config\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.718670 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24d41e59-b89c-4178-91b2-af1dc84e86ed-dbus\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.718670 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718556    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-modprobe-d\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.718670 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718580    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8b4b\" (UniqueName: \"kubernetes.io/projected/78335586-a8b1-475b-b444-f3f5fb9a27bd-kube-api-access-h8b4b\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.718670 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-cnibin\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.718670 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718624    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24d41e59-b89c-4178-91b2-af1dc84e86ed-kubelet-config\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718678    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-conf-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718631    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-conf-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvkq6\" (UniqueName: \"kubernetes.io/projected/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-kube-api-access-lvkq6\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-system-cni-dir\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cnibin\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718786    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718785    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24d41e59-b89c-4178-91b2-af1dc84e86ed-dbus\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-cni-bin\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718887    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysctl-conf\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-netns\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.718999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.718970    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-netns\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719011    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-cni-bin\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-cnibin\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719224    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysctl-conf\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719242    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-modprobe-d\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-ovn\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-systemd\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.719524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.719443    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-ovn\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.725928 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.725896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-var-lib-kubelet\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.726163 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-multus-certs\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.726335 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-sys\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.726457 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726442    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s45dw\" (UniqueName: \"kubernetes.io/projected/d749b6ec-d33e-4b20-8d22-5f332ac2d721-kube-api-access-s45dw\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.726571 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-system-cni-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.726696 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-daemon-config\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.726696 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl5lk\" (UniqueName: \"kubernetes.io/projected/ebaec2da-39eb-45df-ad77-b4e10c7705e4-kube-api-access-kl5lk\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.726855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726718    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-sys\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.726855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-system-cni-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.726855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726828    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-var-lib-kubelet\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.727017 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.725979    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-systemd\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.727017 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726925    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-multus-certs\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.727017 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.726968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d52b0f5-195f-4d56-9d01-74af61d80cee-konnectivity-ca\") pod \"konnectivity-agent-584kl\" (UID: \"1d52b0f5-195f-4d56-9d01-74af61d80cee\") " pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.727017 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727004    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-tuned\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-serviceca\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-sys-fs\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727109    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727128    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-etc-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727211    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovnkube-config\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.727224 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727226    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-run\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d749b6ec-d33e-4b20-8d22-5f332ac2d721-tmp-dir\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727270    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-cni-multus\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-node-log\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-host\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727342    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-kubelet\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c08508d2-a5da-4a94-a332-98739d3932d7-host-slash\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727373    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-daemon-config\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727388    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-systemd-units\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727408    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysctl-d\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-lib-modules\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d749b6ec-d33e-4b20-8d22-5f332ac2d721-hosts-file\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.727601    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:44:57.727738 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.727695    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:44:58.227670543 +0000 UTC m=+3.061914131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727820    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-kubelet\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.727895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-run\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728133    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovnkube-config\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d749b6ec-d33e-4b20-8d22-5f332ac2d721-tmp-dir\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728235    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovnkube-script-lib\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-cni-multus\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728315    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-node-log\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728379    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-host\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.728444 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728446    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-sys-fs\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.728511    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.728567    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret podName:24d41e59-b89c-4178-91b2-af1dc84e86ed nodeName:}" failed. No retries permitted until 2026-07-28 20:44:58.228550671 +0000 UTC m=+3.062794252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret") pod "global-pull-secret-syncer-5chvb" (UID: "24d41e59-b89c-4178-91b2-af1dc84e86ed") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728597    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728624    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728663    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-etc-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728697    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-serviceca\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728817    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysctl-d\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-lib-modules\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.728948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728914    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-systemd-units\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.729496 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d749b6ec-d33e-4b20-8d22-5f332ac2d721-hosts-file\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.729496 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.728987    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 20:44:57.729496 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729098    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-etc-kubernetes\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.729496 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729149    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d52b0f5-195f-4d56-9d01-74af61d80cee-konnectivity-ca\") pod \"konnectivity-agent-584kl\" (UID: \"1d52b0f5-195f-4d56-9d01-74af61d80cee\") " pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.729714 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-etc-kubernetes\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.729714 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729619    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.729714 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-slash\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.729714 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-var-lib-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.729958 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729721    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysconfig\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.729958 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c08508d2-a5da-4a94-a332-98739d3932d7-iptables-alerter-script\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.729958 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729788    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-os-release\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.729958 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729822    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-kubernetes\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.729958 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729846    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-host\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.729958 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.729958 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lkcc\" (UniqueName: \"kubernetes.io/projected/2ac58d4c-790e-4d2e-bd81-376067877ce0-kube-api-access-8lkcc\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.729969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d52b0f5-195f-4d56-9d01-74af61d80cee-agent-certs\") pod \"konnectivity-agent-584kl\" (UID: \"1d52b0f5-195f-4d56-9d01-74af61d80cee\") " pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvd2m\" (UniqueName: \"kubernetes.io/projected/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-kube-api-access-tvd2m\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-cni-bin\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcrz8\" (UniqueName: \"kubernetes.io/projected/c08508d2-a5da-4a94-a332-98739d3932d7-kube-api-access-hcrz8\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-cni-netd\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-registration-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-device-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.730221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730197    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-socket-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730267    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts752\" (UniqueName: \"kubernetes.io/projected/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-kube-api-access-ts752\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-systemd\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-log-socket\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730357    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovn-node-metrics-cert\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a80e5701-d1ec-4ccb-af02-cab4bde712de-tmp\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-cni-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-env-overrides\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f87p\" (UniqueName: \"kubernetes.io/projected/a80e5701-d1ec-4ccb-af02-cab4bde712de-kube-api-access-8f87p\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.730541 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-os-release\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.731094 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730548    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-cni-binary-copy\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.731094 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-socket-dir-parent\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.731094 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-k8s-cni-cncf-io\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.731094 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730643    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-hostroot\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.731094 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730674    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-kubelet\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.731094 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.730717    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-run-netns\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.731398 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.731268    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-run-netns\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.731398 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.731348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-slash\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.731503 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.731406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-var-lib-openvswitch\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.731503 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.731473    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-sysconfig\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.731616 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.731567    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-kubernetes\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.731671 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.731625    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80e5701-d1ec-4ccb-af02-cab4bde712de-host\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.731725 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.731686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.732356 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.732328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-log-socket\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.732522 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.732501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-cni-dir\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.732685 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.732661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-cni-netd\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.732779 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.732744    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-registration-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.732878 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.732798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-device-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.732957 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.732937    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-socket-dir\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.733013 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.732993    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-env-overrides\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.733118 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.733100    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78335586-a8b1-475b-b444-f3f5fb9a27bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.733182 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.733170    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-var-lib-cni-bin\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.733313 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.733296    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-run-systemd\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.733582 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.733550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-os-release\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.734101 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.733786    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-host-run-k8s-cni-cncf-io\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.734292 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.734201    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-multus-socket-dir-parent\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.734292 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.734282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-hostroot\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.734414 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.734341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-host-kubelet\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.734414 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.734370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-cni-binary-copy\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.737094 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.737070    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a80e5701-d1ec-4ccb-af02-cab4bde712de-tmp\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.739032 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.739005    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d52b0f5-195f-4d56-9d01-74af61d80cee-agent-certs\") pod \"konnectivity-agent-584kl\" (UID: \"1d52b0f5-195f-4d56-9d01-74af61d80cee\") " pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.739127 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.739029    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvkq6\" (UniqueName: \"kubernetes.io/projected/44fb4bf7-d2cb-422f-864e-feb2b9b80e69-kube-api-access-lvkq6\") pod \"multus-l47wf\" (UID: \"44fb4bf7-d2cb-422f-864e-feb2b9b80e69\") " pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.739502 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.739478    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8b4b\" (UniqueName: \"kubernetes.io/projected/78335586-a8b1-475b-b444-f3f5fb9a27bd-kube-api-access-h8b4b\") pod \"aws-ebs-csi-driver-node-9k9rn\" (UID: \"78335586-a8b1-475b-b444-f3f5fb9a27bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.740071 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.740032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a80e5701-d1ec-4ccb-af02-cab4bde712de-etc-tuned\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.740355 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.740333    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-ovn-node-metrics-cert\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.746886 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.746862    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:44:57.746886 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.746886    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:44:57.747073 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.746898    2572 projected.go:196] Error preparing data for projected volume kube-api-access-xn86p for pod openshift-network-diagnostics/network-check-target-v7znx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:44:57.747073 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:57.746979    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p podName:2eec7a43-59be-454d-8426-2e9269637c7c nodeName:}" failed. No retries permitted until 2026-07-28 20:44:58.246962096 +0000 UTC m=+3.081205664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xn86p" (UniqueName: "kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p") pod "network-check-target-v7znx" (UID: "2eec7a43-59be-454d-8426-2e9269637c7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:44:57.750705 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.750671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s45dw\" (UniqueName: \"kubernetes.io/projected/d749b6ec-d33e-4b20-8d22-5f332ac2d721-kube-api-access-s45dw\") pod \"node-resolver-9nw5c\" (UID: \"d749b6ec-d33e-4b20-8d22-5f332ac2d721\") " pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.751336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.751311    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lkcc\" (UniqueName: \"kubernetes.io/projected/2ac58d4c-790e-4d2e-bd81-376067877ce0-kube-api-access-8lkcc\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:57.752768 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.752744    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts752\" (UniqueName: \"kubernetes.io/projected/13f16c8b-4714-4a8f-aa63-8bdf85cf52aa-kube-api-access-ts752\") pod \"ovnkube-node-bfwqf\" (UID: \"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.753555 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.753535    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f87p\" (UniqueName: \"kubernetes.io/projected/a80e5701-d1ec-4ccb-af02-cab4bde712de-kube-api-access-8f87p\") pod \"tuned-4vmqk\" (UID: \"a80e5701-d1ec-4ccb-af02-cab4bde712de\") " pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.759626 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.759564    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvd2m\" (UniqueName: \"kubernetes.io/projected/9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab-kube-api-access-tvd2m\") pod \"node-ca-fzprj\" (UID: \"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab\") " pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.831422 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-system-cni-dir\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831422 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cnibin\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831648 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831440    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831648 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831478    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831648 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831479    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-system-cni-dir\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831648 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831504    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831648 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831544    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cnibin\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831648 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831558    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl5lk\" (UniqueName: \"kubernetes.io/projected/ebaec2da-39eb-45df-ad77-b4e10c7705e4-kube-api-access-kl5lk\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831935 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831664    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c08508d2-a5da-4a94-a332-98739d3932d7-host-slash\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.831935 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831935 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c08508d2-a5da-4a94-a332-98739d3932d7-iptables-alerter-script\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.831935 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-os-release\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.831935 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.831819    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcrz8\" (UniqueName: \"kubernetes.io/projected/c08508d2-a5da-4a94-a332-98739d3932d7-kube-api-access-hcrz8\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.832148 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.832027    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.832148 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.832104    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.832469 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.832450    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.832565 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.832504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c08508d2-a5da-4a94-a332-98739d3932d7-host-slash\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.832620 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.832567    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebaec2da-39eb-45df-ad77-b4e10c7705e4-os-release\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.832620 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.832563    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebaec2da-39eb-45df-ad77-b4e10c7705e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.832689 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.832672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c08508d2-a5da-4a94-a332-98739d3932d7-iptables-alerter-script\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.847243 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.847210    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl5lk\" (UniqueName: \"kubernetes.io/projected/ebaec2da-39eb-45df-ad77-b4e10c7705e4-kube-api-access-kl5lk\") pod \"multus-additional-cni-plugins-49799\" (UID: \"ebaec2da-39eb-45df-ad77-b4e10c7705e4\") " pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:57.847405 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.847210    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcrz8\" (UniqueName: \"kubernetes.io/projected/c08508d2-a5da-4a94-a332-98739d3932d7-kube-api-access-hcrz8\") pod \"iptables-alerter-nqw8p\" (UID: \"c08508d2-a5da-4a94-a332-98739d3932d7\") " pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.901189 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.901148    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn"
Jul 28 20:44:57.915166 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.915105    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nw5c"
Jul 28 20:44:57.925890 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.925846    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fzprj"
Jul 28 20:44:57.933197 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.933165    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l47wf"
Jul 28 20:44:57.941352 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.941324    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:44:57.950389 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.950363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:44:57.958585 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.958555    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4vmqk"
Jul 28 20:44:57.967822 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.967776    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqw8p"
Jul 28 20:44:57.973973 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:57.973946    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49799"
Jul 28 20:44:58.234184 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:58.234075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:58.234184 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:58.234130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:58.234417 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.234292    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:44:58.234417 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.234363    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret podName:24d41e59-b89c-4178-91b2-af1dc84e86ed nodeName:}" failed. No retries permitted until 2026-07-28 20:44:59.234345216 +0000 UTC m=+4.068588786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret") pod "global-pull-secret-syncer-5chvb" (UID: "24d41e59-b89c-4178-91b2-af1dc84e86ed") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:44:58.234417 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.234292    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:44:58.234417 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.234399    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:44:59.234391879 +0000 UTC m=+4.068635445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:44:58.335312 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:58.335273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:44:58.335504 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.335451    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:44:58.335504 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.335472    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:44:58.335504 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.335485    2572 projected.go:196] Error preparing data for projected volume kube-api-access-xn86p for pod openshift-network-diagnostics/network-check-target-v7znx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:44:58.335628 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.335560    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p podName:2eec7a43-59be-454d-8426-2e9269637c7c nodeName:}" failed. No retries permitted until 2026-07-28 20:44:59.335542562 +0000 UTC m=+4.169786129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xn86p" (UniqueName: "kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p") pod "network-check-target-v7znx" (UID: "2eec7a43-59be-454d-8426-2e9269637c7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:44:58.669145 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:58.669057    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:39:58 +0000 UTC" deadline="2028-01-11 00:37:20.985727901 +0000 UTC"
Jul 28 20:44:58.669145 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:58.669092    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12747h52m22.316640186s"
Jul 28 20:44:58.711431 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:58.711387    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:58.711640 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:58.711541    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:44:58.813738 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:58.813700    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08508d2_a5da_4a94_a332_98739d3932d7.slice/crio-414b2dcb0108b234b5a1fab9120d128fb3316ad0ba47b5df81d06ed0dba456f2 WatchSource:0}: Error finding container 414b2dcb0108b234b5a1fab9120d128fb3316ad0ba47b5df81d06ed0dba456f2: Status 404 returned error can't find the container with id 414b2dcb0108b234b5a1fab9120d128fb3316ad0ba47b5df81d06ed0dba456f2
Jul 28 20:44:58.839710 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:58.839668    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebaec2da_39eb_45df_ad77_b4e10c7705e4.slice/crio-5d4a034e3781ffc5f5660130810141f64a3e60298e7141de48ba2eaebf904060 WatchSource:0}: Error finding container 5d4a034e3781ffc5f5660130810141f64a3e60298e7141de48ba2eaebf904060: Status 404 returned error can't find the container with id 5d4a034e3781ffc5f5660130810141f64a3e60298e7141de48ba2eaebf904060
Jul 28 20:44:58.840446 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:58.840386    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44fb4bf7_d2cb_422f_864e_feb2b9b80e69.slice/crio-d6e355b8c7b57fa87b9839779365dcecc9f18b75df5c3e7f5428412d1bd2928f WatchSource:0}: Error finding container d6e355b8c7b57fa87b9839779365dcecc9f18b75df5c3e7f5428412d1bd2928f: Status 404 returned error can't find the container with id d6e355b8c7b57fa87b9839779365dcecc9f18b75df5c3e7f5428412d1bd2928f
Jul 28 20:44:58.841479 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:58.841460    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78335586_a8b1_475b_b444_f3f5fb9a27bd.slice/crio-d65e5dde66fb64d32d095e2239f5fb1598d7985dc73b6383b3959eae6e71d729 WatchSource:0}: Error finding container d65e5dde66fb64d32d095e2239f5fb1598d7985dc73b6383b3959eae6e71d729: Status 404 returned error can't find the container with id d65e5dde66fb64d32d095e2239f5fb1598d7985dc73b6383b3959eae6e71d729
Jul 28 20:44:58.843132 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:58.843033    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80e5701_d1ec_4ccb_af02_cab4bde712de.slice/crio-831fc4c6dd55ba578d1ffeb6450ae28d19026b7c0b713a3071989f2e08647d67 WatchSource:0}: Error finding container 831fc4c6dd55ba578d1ffeb6450ae28d19026b7c0b713a3071989f2e08647d67: Status 404 returned error can't find the container with id 831fc4c6dd55ba578d1ffeb6450ae28d19026b7c0b713a3071989f2e08647d67
Jul 28 20:44:58.845401 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:58.845375    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d52b0f5_195f_4d56_9d01_74af61d80cee.slice/crio-a06ce69c23c44146ee282f84b054ede5a0bfacef620e17bf2b23d95b04f0fc54 WatchSource:0}: Error finding container a06ce69c23c44146ee282f84b054ede5a0bfacef620e17bf2b23d95b04f0fc54: Status 404 returned error can't find the container with id a06ce69c23c44146ee282f84b054ede5a0bfacef620e17bf2b23d95b04f0fc54
Jul 28 20:44:58.849871 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:44:58.849369    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f16c8b_4714_4a8f_aa63_8bdf85cf52aa.slice/crio-af3beb1defb788cd7e364eeb098a3f994a80a71999948390a8a2b7fc2a65ecef WatchSource:0}: Error finding container af3beb1defb788cd7e364eeb098a3f994a80a71999948390a8a2b7fc2a65ecef: Status 404 returned error can't find the container with id af3beb1defb788cd7e364eeb098a3f994a80a71999948390a8a2b7fc2a65ecef
Jul 28 20:44:59.242630 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.242350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:59.242630 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.242610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:44:59.242851 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.242521    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:44:59.242851 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.242706    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:01.242688609 +0000 UTC m=+6.076932178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:44:59.242851 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.242724    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:44:59.242851 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.242772    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret podName:24d41e59-b89c-4178-91b2-af1dc84e86ed nodeName:}" failed. No retries permitted until 2026-07-28 20:45:01.242758181 +0000 UTC m=+6.077001763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret") pod "global-pull-secret-syncer-5chvb" (UID: "24d41e59-b89c-4178-91b2-af1dc84e86ed") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:44:59.343462 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.343416    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:44:59.343671 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.343597    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:44:59.343671 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.343621    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:44:59.343671 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.343636    2572 projected.go:196] Error preparing data for projected volume kube-api-access-xn86p for pod openshift-network-diagnostics/network-check-target-v7znx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:44:59.343879 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.343700    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p podName:2eec7a43-59be-454d-8426-2e9269637c7c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:01.3436805 +0000 UTC m=+6.177924083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xn86p" (UniqueName: "kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p") pod "network-check-target-v7znx" (UID: "2eec7a43-59be-454d-8426-2e9269637c7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:44:59.670231 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.670095    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:39:58 +0000 UTC" deadline="2028-01-17 13:16:55.519000022 +0000 UTC"
Jul 28 20:44:59.670231 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.670167    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12904h31m55.848837813s"
Jul 28 20:44:59.713971 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.713938    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:44:59.714159 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.714085    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:44:59.714596 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.714539    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:44:59.714707 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:44:59.714635    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:44:59.726822 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.726782    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" event={"ID":"507b913257a62c292c095cec0ddb2c1c","Type":"ContainerStarted","Data":"aea06f0484a011589e639d383b271333860719ad260574558628ed79b2fb83b0"}
Jul 28 20:44:59.734348 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.734306    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-584kl" event={"ID":"1d52b0f5-195f-4d56-9d01-74af61d80cee","Type":"ContainerStarted","Data":"a06ce69c23c44146ee282f84b054ede5a0bfacef620e17bf2b23d95b04f0fc54"}
Jul 28 20:44:59.749972 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.749791    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn" event={"ID":"78335586-a8b1-475b-b444-f3f5fb9a27bd","Type":"ContainerStarted","Data":"d65e5dde66fb64d32d095e2239f5fb1598d7985dc73b6383b3959eae6e71d729"}
Jul 28 20:44:59.760677 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.760628    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l47wf" event={"ID":"44fb4bf7-d2cb-422f-864e-feb2b9b80e69","Type":"ContainerStarted","Data":"d6e355b8c7b57fa87b9839779365dcecc9f18b75df5c3e7f5428412d1bd2928f"}
Jul 28 20:44:59.768408 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.768360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqw8p" event={"ID":"c08508d2-a5da-4a94-a332-98739d3932d7","Type":"ContainerStarted","Data":"414b2dcb0108b234b5a1fab9120d128fb3316ad0ba47b5df81d06ed0dba456f2"}
Jul 28 20:44:59.781135 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.780997    2572 generic.go:356] "Generic (PLEG): container finished" podID="a10f0822328051138d7bd1e05813a022" containerID="33a9abf83351f0e9993ba0e19bcd87644e69d1897e81a23ca0f81ac1ed5f07fc" exitCode=0
Jul 28 20:44:59.781135 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.781058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" event={"ID":"a10f0822328051138d7bd1e05813a022","Type":"ContainerDied","Data":"33a9abf83351f0e9993ba0e19bcd87644e69d1897e81a23ca0f81ac1ed5f07fc"}
Jul 28 20:44:59.798525 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.798310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nw5c" event={"ID":"d749b6ec-d33e-4b20-8d22-5f332ac2d721","Type":"ContainerStarted","Data":"a8d7459f59e972d9310c85810d72581b78ff320848037cc2ac6eb84ab90ad3a2"}
Jul 28 20:44:59.804647 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.804136    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-57.ec2.internal" podStartSLOduration=2.803844612 podStartE2EDuration="2.803844612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:44:59.747694833 +0000 UTC m=+4.581938422" watchObservedRunningTime="2026-07-28 20:44:59.803844612 +0000 UTC m=+4.638088203"
Jul 28 20:44:59.809041 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.809004    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fzprj" event={"ID":"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab","Type":"ContainerStarted","Data":"36ae285e5856fa6a734a0d649b093594876788ebb0a5b1eeb42382d7bea74440"}
Jul 28 20:44:59.814524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.814330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"af3beb1defb788cd7e364eeb098a3f994a80a71999948390a8a2b7fc2a65ecef"}
Jul 28 20:44:59.828235 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.828137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4vmqk" event={"ID":"a80e5701-d1ec-4ccb-af02-cab4bde712de","Type":"ContainerStarted","Data":"831fc4c6dd55ba578d1ffeb6450ae28d19026b7c0b713a3071989f2e08647d67"}
Jul 28 20:44:59.834787 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:44:59.834676    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerStarted","Data":"5d4a034e3781ffc5f5660130810141f64a3e60298e7141de48ba2eaebf904060"}
Jul 28 20:45:00.711469 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:00.711428    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:00.712039 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:00.711618    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:00.849970 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:00.849932    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" event={"ID":"a10f0822328051138d7bd1e05813a022","Type":"ContainerStarted","Data":"fff055f8d008898a072f1b905222fb7817678e5c765d270f69d4b54c9338ef45"}
Jul 28 20:45:00.868241 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:00.868146    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-57.ec2.internal" podStartSLOduration=3.868121173 podStartE2EDuration="3.868121173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:00.868067961 +0000 UTC m=+5.702311553" watchObservedRunningTime="2026-07-28 20:45:00.868121173 +0000 UTC m=+5.702364765"
Jul 28 20:45:01.262088 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:01.262041    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:01.262301 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:01.262103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:01.262301 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.262248    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:01.262438 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.262316    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret podName:24d41e59-b89c-4178-91b2-af1dc84e86ed nodeName:}" failed. No retries permitted until 2026-07-28 20:45:05.262296833 +0000 UTC m=+10.096540426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret") pod "global-pull-secret-syncer-5chvb" (UID: "24d41e59-b89c-4178-91b2-af1dc84e86ed") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:01.262764 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.262741    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:01.262876 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.262806    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:05.262790703 +0000 UTC m=+10.097034291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:01.363118 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:01.363070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:01.363348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.363281    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:45:01.363348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.363302    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:45:01.363348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.363317    2572 projected.go:196] Error preparing data for projected volume kube-api-access-xn86p for pod openshift-network-diagnostics/network-check-target-v7znx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:01.363553 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.363380    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p podName:2eec7a43-59be-454d-8426-2e9269637c7c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:05.363359915 +0000 UTC m=+10.197603497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xn86p" (UniqueName: "kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p") pod "network-check-target-v7znx" (UID: "2eec7a43-59be-454d-8426-2e9269637c7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:01.712603 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:01.711965    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:01.712603 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.712122    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:01.713438 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:01.713196    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:01.713438 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:01.713280    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:02.712053 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:02.711477    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:02.712053 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:02.711619    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:03.714259 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:03.713478    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:03.714259 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:03.713612    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:03.714259 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:03.714016    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:03.714259 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:03.714117    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:04.711011 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:04.710976    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:04.711189 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:04.711116    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:05.299178 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:05.299137    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:05.299588 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:05.299196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:05.299588 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.299278    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:05.299588 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.299336    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:05.299588 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.299345    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:13.299329765 +0000 UTC m=+18.133573329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:05.299588 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.299407    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret podName:24d41e59-b89c-4178-91b2-af1dc84e86ed nodeName:}" failed. No retries permitted until 2026-07-28 20:45:13.299389314 +0000 UTC m=+18.133632879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret") pod "global-pull-secret-syncer-5chvb" (UID: "24d41e59-b89c-4178-91b2-af1dc84e86ed") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:05.401250 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:05.400643    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:05.401250 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.400831    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:45:05.401250 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.400853    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:45:05.401250 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.400865    2572 projected.go:196] Error preparing data for projected volume kube-api-access-xn86p for pod openshift-network-diagnostics/network-check-target-v7znx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:05.401250 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.400925    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p podName:2eec7a43-59be-454d-8426-2e9269637c7c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:13.400909208 +0000 UTC m=+18.235152778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xn86p" (UniqueName: "kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p") pod "network-check-target-v7znx" (UID: "2eec7a43-59be-454d-8426-2e9269637c7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:05.712584 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:05.712496    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:05.712749 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.712616    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:05.713027 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:05.713000    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:05.713143 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:05.713115    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:06.711413 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:06.711375    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:06.711896 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:06.711518    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:07.716177 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:07.715510    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:07.716177 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:07.715645    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:07.716177 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:07.716049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:07.716177 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:07.716133    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:08.711265 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:08.711233    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:08.711455 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:08.711354    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:09.711079 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:09.711041    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:09.711551 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:09.711046    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:09.711551 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:09.711191    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:09.711551 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:09.711279    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:10.710903 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:10.710822    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:10.711080 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:10.710956    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:11.714440 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:11.714397    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:11.714884 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:11.714524    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:11.714884 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:11.714587    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:11.714884 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:11.714673    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:12.710988 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:12.710954    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:12.711224 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:12.711078    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:13.357304 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:13.357264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:13.357304 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:13.357308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:13.357960 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.357442    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:13.357960 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.357443    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:13.357960 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.357517    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret podName:24d41e59-b89c-4178-91b2-af1dc84e86ed nodeName:}" failed. No retries permitted until 2026-07-28 20:45:29.357495607 +0000 UTC m=+34.191739171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret") pod "global-pull-secret-syncer-5chvb" (UID: "24d41e59-b89c-4178-91b2-af1dc84e86ed") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:13.357960 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.357538    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:29.35752736 +0000 UTC m=+34.191770934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:13.458343 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:13.458302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:13.458530 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.458509    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:45:13.458587 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.458542    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:45:13.458587 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.458556    2572 projected.go:196] Error preparing data for projected volume kube-api-access-xn86p for pod openshift-network-diagnostics/network-check-target-v7znx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:13.458660 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.458623    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p podName:2eec7a43-59be-454d-8426-2e9269637c7c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:29.458602772 +0000 UTC m=+34.292846341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xn86p" (UniqueName: "kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p") pod "network-check-target-v7znx" (UID: "2eec7a43-59be-454d-8426-2e9269637c7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:13.711737 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:13.711698    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:13.711737 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:13.711742    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:13.712008 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.711852    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:13.712081 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:13.712016    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:14.711255 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:14.711226    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:14.711724 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:14.711351    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:15.712864 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:15.712831    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:15.713314 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:15.712874    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:15.713314 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:15.712943    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:15.713314 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:15.713065    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:16.711693 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:16.711655    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:16.711909 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:16.711805    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:17.710947 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:17.710901    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:17.711423 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:17.710963    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:17.711423 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:17.711067    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:17.711423 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:17.711167    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:18.712155 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.711846    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:18.713103 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:18.712232    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:18.904140 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.904055    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nw5c" event={"ID":"d749b6ec-d33e-4b20-8d22-5f332ac2d721","Type":"ContainerStarted","Data":"3fa2b8aad84589eee4c35d1879cf1b1bb18b4649d6d4250c0b9f52b0eb3af78a"}
Jul 28 20:45:18.905458 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.905432    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fzprj" event={"ID":"9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab","Type":"ContainerStarted","Data":"5bdb76cd6759070e14748bdecbf6d068f2565894c0fada67acf66c7f83833d25"}
Jul 28 20:45:18.908159 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.908137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"9358fb9f357b38b9f83130f7eda053cc0752cc8a125b9f0e733fcdf995d6ec05"}
Jul 28 20:45:18.908277 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.908191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"1ecacd372a2e962b44c0acaeaf88cd40788485f1b4c2320ba1a92a2b9b9c5864"}
Jul 28 20:45:18.908277 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.908239    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"8e384e47b6d024edcc15a1ed1c515d6dd8200ee1e2119aed7ad92d7c49115680"}
Jul 28 20:45:18.908381 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.908289    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"d611efa87a11aba6cee84ef13fac153567161ac876692a646ac9d26b913d7ac9"}
Jul 28 20:45:18.908381 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.908319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"dce1389ab268e7d31746764d1ff90e933a231280ea1fe347e0278c123b3cbdba"}
Jul 28 20:45:18.908461 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.908356    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"f20c7bec993d0184f0708d58e41568a31a319745b84df273dc44d6408697ba0d"}
Jul 28 20:45:18.909603 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.909583    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4vmqk" event={"ID":"a80e5701-d1ec-4ccb-af02-cab4bde712de","Type":"ContainerStarted","Data":"b663fcc7d7707b205e24e1a1650331ac7b293968208a12d7c95bdca175857c1f"}
Jul 28 20:45:18.911055 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.911035    2572 generic.go:356] "Generic (PLEG): container finished" podID="ebaec2da-39eb-45df-ad77-b4e10c7705e4" containerID="671776037cf1b4d2bb9fb582d373895692e35e1cbc05c21b03e1d21aa3d4bd35" exitCode=0
Jul 28 20:45:18.911144 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.911101    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerDied","Data":"671776037cf1b4d2bb9fb582d373895692e35e1cbc05c21b03e1d21aa3d4bd35"}
Jul 28 20:45:18.912628 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.912607    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-584kl" event={"ID":"1d52b0f5-195f-4d56-9d01-74af61d80cee","Type":"ContainerStarted","Data":"eb32f4c380cccc03a62520ebfe13138db1cb61499315df4ea470b3e1dc7401ed"}
Jul 28 20:45:18.914170 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.914149    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn" event={"ID":"78335586-a8b1-475b-b444-f3f5fb9a27bd","Type":"ContainerStarted","Data":"4bb5baffc5d0458cbcd1bb0f7dc30cd73918f2f1c960c0b65b367739359e097d"}
Jul 28 20:45:18.915511 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.915490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l47wf" event={"ID":"44fb4bf7-d2cb-422f-864e-feb2b9b80e69","Type":"ContainerStarted","Data":"cb65e7ef33256b8dc06ba7c92ba038508cff402dcd643540247e2599b078ad30"}
Jul 28 20:45:18.922960 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.922915    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9nw5c" podStartSLOduration=3.705323067 podStartE2EDuration="22.922902827s" totalImagesPullingTime="19.21757976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:18.92250187 +0000 UTC m=+23.756745455" watchObservedRunningTime="2026-07-28 20:45:18.922902827 +0000 UTC m=+23.757146413"
Jul 28 20:45:18.941454 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:18.941405    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4vmqk" podStartSLOduration=3.715913833 podStartE2EDuration="22.941389809s" totalImagesPullingTime="19.225475976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:18.941279114 +0000 UTC m=+23.775522701" watchObservedRunningTime="2026-07-28 20:45:18.941389809 +0000 UTC m=+23.775633392"
Jul 28 20:45:19.029989 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.029927    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fzprj" podStartSLOduration=3.81121455 podStartE2EDuration="23.029904177s" totalImagesPullingTime="19.218689627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:19.028724389 +0000 UTC m=+23.862967967" watchObservedRunningTime="2026-07-28 20:45:19.029904177 +0000 UTC m=+23.864147764"
Jul 28 20:45:19.109556 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.109496    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l47wf" podStartSLOduration=3.817699039 podStartE2EDuration="23.109471564s" totalImagesPullingTime="19.291772525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:19.082292207 +0000 UTC m=+23.916535794" watchObservedRunningTime="2026-07-28 20:45:19.109471564 +0000 UTC m=+23.943715151"
Jul 28 20:45:19.109796 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.109753    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-584kl" podStartSLOduration=3.893640203 podStartE2EDuration="23.109745658s" totalImagesPullingTime="19.216105455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:19.10892604 +0000 UTC m=+23.943169627" watchObservedRunningTime="2026-07-28 20:45:19.109745658 +0000 UTC m=+23.943989247"
Jul 28 20:45:19.711969 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.711678    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:19.711969 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:19.711820    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:19.711969 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.711857    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:19.711969 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:19.711943    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:19.857353 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.857325    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 20:45:19.920143 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.920103    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqw8p" event={"ID":"c08508d2-a5da-4a94-a332-98739d3932d7","Type":"ContainerStarted","Data":"bd391edd7773f496f936425d2452c8d102907a9d8ef48e329c3f14c7bf25a40e"}
Jul 28 20:45:19.922325 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:19.922290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn" event={"ID":"78335586-a8b1-475b-b444-f3f5fb9a27bd","Type":"ContainerStarted","Data":"22d43d5172173d3c140f110c3a7a3febed84c7dfa66947730ef7b3311bb0021e"}
Jul 28 20:45:20.672644 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:20.672522    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T20:45:19.857343673Z","UUID":"5ec1b381-0837-4c91-a01d-0fc41d1cdf0e","Handler":null,"Name":"","Endpoint":""}
Jul 28 20:45:20.674217 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:20.674196    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 20:45:20.674347 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:20.674239    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 20:45:20.710789 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:20.710747    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:20.710946 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:20.710867    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:20.929536 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:20.929440    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"ef3a15df8162857515d2218418442d3c7f94b9e90d2aeadd01f36eeabe6c56b0"}
Jul 28 20:45:21.711374 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:21.711330    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:21.711567 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:21.711450    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:21.711567 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:21.711504    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:21.711680 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:21.711597    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:22.493560 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:22.493521    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:45:22.494372 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:22.494349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:45:22.513447 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:22.513391    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nqw8p" podStartSLOduration=7.271551455 podStartE2EDuration="26.513373222s" totalImagesPullingTime="19.241821767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:19.944387715 +0000 UTC m=+24.778631303" watchObservedRunningTime="2026-07-28 20:45:22.513373222 +0000 UTC m=+27.347616808"
Jul 28 20:45:22.711158 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:22.711126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:22.711330 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:22.711256    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:22.933953 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:22.933918    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:45:22.934495 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:22.934474    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-584kl"
Jul 28 20:45:23.711764 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.711586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:23.712577 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.711586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:23.712577 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:23.711881    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:23.712577 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:23.711902    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:23.937790 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.937755    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn" event={"ID":"78335586-a8b1-475b-b444-f3f5fb9a27bd","Type":"ContainerStarted","Data":"c0a25d37cdbd6f50891d249e8046801df11adec5dfad986995a8c2cc5b82d614"}
Jul 28 20:45:23.941045 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.940963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" event={"ID":"13f16c8b-4714-4a8f-aa63-8bdf85cf52aa","Type":"ContainerStarted","Data":"069b05c5bd2badb568cccccdcc0813879c812b5ea85d68e5c387b0ce87cc5b20"}
Jul 28 20:45:23.941164 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.941114    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:45:23.941221 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.941197    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:45:23.942969 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.942949    2572 generic.go:356] "Generic (PLEG): container finished" podID="ebaec2da-39eb-45df-ad77-b4e10c7705e4" containerID="a6be0bd02a110428d3d3315eba71678e0ee1f7a7c6a6090897a5acec5080f16f" exitCode=0
Jul 28 20:45:23.943085 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.943017    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerDied","Data":"a6be0bd02a110428d3d3315eba71678e0ee1f7a7c6a6090897a5acec5080f16f"}
Jul 28 20:45:23.957167 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.957145    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:45:23.959553 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.959495    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k9rn" podStartSLOduration=3.841380524 podStartE2EDuration="27.959481569s" totalImagesPullingTime="24.118101045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:23.959143952 +0000 UTC m=+28.793387570" watchObservedRunningTime="2026-07-28 20:45:23.959481569 +0000 UTC m=+28.793725151"
Jul 28 20:45:23.989701 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:23.989652    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf" podStartSLOduration=8.705844922 podStartE2EDuration="27.989637852s" totalImagesPullingTime="19.28379293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:23.988350196 +0000 UTC m=+28.822593781" watchObservedRunningTime="2026-07-28 20:45:23.989637852 +0000 UTC m=+28.823881438"
Jul 28 20:45:24.711637 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:24.711382    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:24.711916 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:24.711746    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:24.945919 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:24.945893    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:45:24.961825 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:24.961749    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:45:25.668168 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.668137    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5chvb"]
Jul 28 20:45:25.668385 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.668249    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:25.668385 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:25.668349    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:25.671855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.671819    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b6hg6"]
Jul 28 20:45:25.671982 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.671928    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:25.672077 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:25.672049    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:25.674969 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.674943    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v7znx"]
Jul 28 20:45:25.675108 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.675068    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:25.675178 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:25.675160    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:25.949683 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.949588    2572 generic.go:356] "Generic (PLEG): container finished" podID="ebaec2da-39eb-45df-ad77-b4e10c7705e4" containerID="92cfeb26561dec4f1ba7d3eca0378221d4bddede0605ae6e2aa205a6dc21ca3f" exitCode=0
Jul 28 20:45:25.949683 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:25.949673    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerDied","Data":"92cfeb26561dec4f1ba7d3eca0378221d4bddede0605ae6e2aa205a6dc21ca3f"}
Jul 28 20:45:26.711317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:26.711277    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:26.711504 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:26.711389    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:27.711219 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:27.711189    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:27.711684 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:27.711226    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:27.711684 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:27.711309    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:27.711684 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:27.711421    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:27.956880 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:27.956841    2572 generic.go:356] "Generic (PLEG): container finished" podID="ebaec2da-39eb-45df-ad77-b4e10c7705e4" containerID="a376fa411d256e3dcbcb92f4e92311af7fd76f581c80a31d517e6e7dd39f7b62" exitCode=0
Jul 28 20:45:27.957082 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:27.956893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerDied","Data":"a376fa411d256e3dcbcb92f4e92311af7fd76f581c80a31d517e6e7dd39f7b62"}
Jul 28 20:45:28.711767 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:28.711736    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:28.712163 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:28.711862    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:29.380351 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:29.380323    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:29.380530 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:29.380360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:29.380530 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.380475    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:29.380530 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.380478    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:29.380530 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.380525    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret podName:24d41e59-b89c-4178-91b2-af1dc84e86ed nodeName:}" failed. No retries permitted until 2026-07-28 20:46:01.380512063 +0000 UTC m=+66.214755626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret") pod "global-pull-secret-syncer-5chvb" (UID: "24d41e59-b89c-4178-91b2-af1dc84e86ed") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:45:29.380675 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.380539    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:01.380532479 +0000 UTC m=+66.214776042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:45:29.481136 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:29.481105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:29.481288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.481233    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:45:29.481288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.481247    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:45:29.481288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.481256    2572 projected.go:196] Error preparing data for projected volume kube-api-access-xn86p for pod openshift-network-diagnostics/network-check-target-v7znx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:29.481385 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.481303    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p podName:2eec7a43-59be-454d-8426-2e9269637c7c nodeName:}" failed. No retries permitted until 2026-07-28 20:46:01.481291349 +0000 UTC m=+66.315534913 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xn86p" (UniqueName: "kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p") pod "network-check-target-v7znx" (UID: "2eec7a43-59be-454d-8426-2e9269637c7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:45:29.711512 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:29.711425    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:29.711512 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:29.711470    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:29.711724 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.711552    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b6hg6" podUID="2ac58d4c-790e-4d2e-bd81-376067877ce0"
Jul 28 20:45:29.711724 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:29.711650    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5chvb" podUID="24d41e59-b89c-4178-91b2-af1dc84e86ed"
Jul 28 20:45:30.711646 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:30.711610    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:30.712150 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:30.711745    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7znx" podUID="2eec7a43-59be-454d-8426-2e9269637c7c"
Jul 28 20:45:30.981995 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:30.981958    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-57.ec2.internal" event="NodeReady"
Jul 28 20:45:30.982176 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:30.982120    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 20:45:31.052759 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.052725    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"]
Jul 28 20:45:31.056755 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.056711    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dmh6c"]
Jul 28 20:45:31.056970 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.056908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:31.060367 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.060159    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 20:45:31.060560 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.060237    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.060765 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.060748    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.061014 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.060996    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"]
Jul 28 20:45:31.061139 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.061124    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.065087 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.065065    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"]
Jul 28 20:45:31.065217 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.065199    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"
Jul 28 20:45:31.065911 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.065890    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bzp98\""
Jul 28 20:45:31.066352 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.066335    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8t988\""
Jul 28 20:45:31.066511 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.066476    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 20:45:31.067121 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.067103    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.067592 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.067327    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.070675 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.068733    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 20:45:31.070675 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.068751    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.070675 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.069152    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k8pnh\""
Jul 28 20:45:31.070675 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.069418    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"]
Jul 28 20:45:31.070675 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.069821    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.071098 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.071077    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.075066 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.075038    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-866c8d54bc-s8zbn"]
Jul 28 20:45:31.075194 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.075173    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.077957 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.077838    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 20:45:31.079067 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.079046    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"]
Jul 28 20:45:31.079246 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.079140    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.082476 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.082452    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-tbmzs"]
Jul 28 20:45:31.082831 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.082813    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.086186 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.086161    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-ff76cddc9-wcv8g"]
Jul 28 20:45:31.086944 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.086925    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.091297 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.091251    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.092076 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.091527    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 28 20:45:31.092076 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.091880    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.092076 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.091904    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.092076 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.091884    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.092076 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.091881    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 20:45:31.092370 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.092232    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 28 20:45:31.092952 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.092929    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 20:45:31.093125 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.093106    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 20:45:31.093309 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.093295    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 20:45:31.093516 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.093484    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.093734 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.093690    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"]
Jul 28 20:45:31.094021 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.093992    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 20:45:31.094102 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094031    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 20:45:31.094164 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094108    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fc5w2\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094223    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w2hgh\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094234    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7jg7q\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094331    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.093997    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094483    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094608    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094714    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kskpf\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.094832    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vrp64\""
Jul 28 20:45:31.095843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.095768    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"]
Jul 28 20:45:31.099949 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.099926    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"]
Jul 28 20:45:31.105256 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.105227    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.105481 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.105465    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"]
Jul 28 20:45:31.107450 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.107428    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dmh6c"]
Jul 28 20:45:31.108432 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.108409    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 20:45:31.108537 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.108512    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.108620 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.108601    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 20:45:31.108676 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.108421    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 20:45:31.108774 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.108758    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 20:45:31.108847 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.108813    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 20:45:31.108948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.108929    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.109234 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.109203    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.109640 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.109607    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ff76cddc9-wcv8g"]
Jul 28 20:45:31.110519 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.110498    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-58ks8\""
Jul 28 20:45:31.110820 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.110803    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866c8d54bc-s8zbn"]
Jul 28 20:45:31.111497 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.111479    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g4jxs"]
Jul 28 20:45:31.119108 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.119081    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 20:45:31.119412 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.119389    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 20:45:31.122716 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.122692    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"]
Jul 28 20:45:31.123370 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.123350    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.127026 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.127001    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 20:45:31.127616 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.127601    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ph6jd\""
Jul 28 20:45:31.128204 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.128182    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 20:45:31.132009 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.130294    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"]
Jul 28 20:45:31.132009 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.131978    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:31.135823 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.135799    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g4gvn"]
Jul 28 20:45:31.135933 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.135912    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 20:45:31.136008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.135966    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.136148 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.136131    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 20:45:31.136499 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.136479    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rn8mk\""
Jul 28 20:45:31.138927 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.138904    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h4np9\""
Jul 28 20:45:31.139680 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.139662    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"]
Jul 28 20:45:31.139868 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.139851    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.140063 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.140042    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 20:45:31.140262 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.140235    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.140359 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.140329    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.140725 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.140708    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 20:45:31.142381 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.142360    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 20:45:31.142478 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.142461    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.142530 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.142488    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kmbt4\""
Jul 28 20:45:31.143045 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.143026    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.146629 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.146602    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"]
Jul 28 20:45:31.146843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.146644    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"]
Jul 28 20:45:31.147404 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.147292    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"
Jul 28 20:45:31.151115 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.151092    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 20:45:31.151295 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.151274    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kjzl4\""
Jul 28 20:45:31.151848 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.151830    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 20:45:31.152979 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.152958    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"]
Jul 28 20:45:31.153080 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.153064    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.155357 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.155335    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 20:45:31.156661 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156637    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-tbmzs"]
Jul 28 20:45:31.156771 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156689    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"]
Jul 28 20:45:31.156771 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156712    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4jxs"]
Jul 28 20:45:31.156771 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156739    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"]
Jul 28 20:45:31.156771 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156756    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"]
Jul 28 20:45:31.156997 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4gvn"]
Jul 28 20:45:31.156997 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156819    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"]
Jul 28 20:45:31.156997 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156847    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"]
Jul 28 20:45:31.156997 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.156883    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.163003 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.162670    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 20:45:31.163003 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.162738    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 20:45:31.163003 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.162799    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 20:45:31.163003 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.162739    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 20:45:31.192929 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.192886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqpd2\" (UniqueName: \"kubernetes.io/projected/a7b98624-56de-4710-b2cc-e4b4889f391d-kube-api-access-fqpd2\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.193495 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23c0027b-a4e7-4939-8aaf-deda3a9ee484-config-volume\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.193660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b98624-56de-4710-b2cc-e4b4889f391d-config\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.193660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-ca-trust-extracted\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.193660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f872cb95-d3c5-4f9c-a22f-73dc88da028d-tmp\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.193660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwspb\" (UniqueName: \"kubernetes.io/projected/d77639c8-4cde-4fbb-bfd9-6135d793d25d-kube-api-access-bwspb\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.193660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d77639c8-4cde-4fbb-bfd9-6135d793d25d-serving-cert\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.193939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193705    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.193939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193815    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-certificates\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.193939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-trusted-ca\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.193939 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193920    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:31.194120 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bcb3f8a-3b1b-434b-bb58-791882b8b654-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.194120 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.193986    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d77639c8-4cde-4fbb-bfd9-6135d793d25d-trusted-ca\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.194120 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194044    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f872cb95-d3c5-4f9c-a22f-73dc88da028d-service-ca-bundle\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.194120 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp65q\" (UniqueName: \"kubernetes.io/projected/52b65981-f714-4678-bd2e-c80ac42f2244-kube-api-access-zp65q\") pod \"volume-data-source-validator-549c6d54cf-jtcrb\" (UID: \"52b65981-f714-4678-bd2e-c80ac42f2244\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"
Jul 28 20:45:31.194317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkjw\" (UniqueName: \"kubernetes.io/projected/066c3763-70d4-4496-9993-09cd26a2e18c-kube-api-access-twkjw\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.194317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-default-certificate\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.194317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194188    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.194317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b98624-56de-4710-b2cc-e4b4889f391d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.194317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bcb3f8a-3b1b-434b-bb58-791882b8b654-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.194317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194299    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-stats-auth\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.194609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194329    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.194609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194361    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-image-registry-private-configuration\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.194609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d77639c8-4cde-4fbb-bfd9-6135d793d25d-config\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.194609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194462    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdcl\" (UniqueName: \"kubernetes.io/projected/23c0027b-a4e7-4939-8aaf-deda3a9ee484-kube-api-access-mmdcl\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.194609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qrm\" (UniqueName: \"kubernetes.io/projected/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-kube-api-access-x4qrm\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:31.194609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.194609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194586    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-installation-pull-secrets\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.194966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-bound-sa-token\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.194966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82dr\" (UniqueName: \"kubernetes.io/projected/9bcb3f8a-3b1b-434b-bb58-791882b8b654-kube-api-access-w82dr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.194966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:31.194966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f872cb95-d3c5-4f9c-a22f-73dc88da028d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.194966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d24rz\" (UniqueName: \"kubernetes.io/projected/f872cb95-d3c5-4f9c-a22f-73dc88da028d-kube-api-access-d24rz\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.194966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx79s\" (UniqueName: \"kubernetes.io/projected/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-kube-api-access-sx79s\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.194966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.194936    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23c0027b-a4e7-4939-8aaf-deda3a9ee484-tmp-dir\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.195298 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.195008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.195298 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.195034    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:31.195298 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.195065    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f872cb95-d3c5-4f9c-a22f-73dc88da028d-snapshots\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.195298 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.195095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f872cb95-d3c5-4f9c-a22f-73dc88da028d-serving-cert\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.195298 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.195121    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/066c3763-70d4-4496-9993-09cd26a2e18c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.195298 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.195161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t8gj\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-kube-api-access-9t8gj\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.295834 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc9dt\" (UniqueName: \"kubernetes.io/projected/51ab3944-86e8-4a00-a136-381721b9d84d-kube-api-access-cc9dt\") pod \"managed-serviceaccount-addon-agent-79cf458db6-8p6qf\" (UID: \"51ab3944-86e8-4a00-a136-381721b9d84d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.295834 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295763    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb747b6-437a-4157-aadb-855489061b3e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.295834 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbw6x\" (UniqueName: \"kubernetes.io/projected/e7b3e7e7-2c39-483b-93a7-fad9fef864e1-kube-api-access-lbw6x\") pod \"ingress-canary-g4gvn\" (UID: \"e7b3e7e7-2c39-483b-93a7-fad9fef864e1\") " pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqpd2\" (UniqueName: \"kubernetes.io/projected/a7b98624-56de-4710-b2cc-e4b4889f391d-kube-api-access-fqpd2\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23c0027b-a4e7-4939-8aaf-deda3a9ee484-config-volume\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b98624-56de-4710-b2cc-e4b4889f391d-config\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295915    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-ca-trust-extracted\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f872cb95-d3c5-4f9c-a22f-73dc88da028d-tmp\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295964    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwspb\" (UniqueName: \"kubernetes.io/projected/d77639c8-4cde-4fbb-bfd9-6135d793d25d-kube-api-access-bwspb\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.295979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-ca\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d77639c8-4cde-4fbb-bfd9-6135d793d25d-serving-cert\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-certificates\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-trusted-ca\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296090    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bcb3f8a-3b1b-434b-bb58-791882b8b654-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.296137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d77639c8-4cde-4fbb-bfd9-6135d793d25d-trusted-ca\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-tmp\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296202    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f872cb95-d3c5-4f9c-a22f-73dc88da028d-service-ca-bundle\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296225    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp65q\" (UniqueName: \"kubernetes.io/projected/52b65981-f714-4678-bd2e-c80ac42f2244-kube-api-access-zp65q\") pod \"volume-data-source-validator-549c6d54cf-jtcrb\" (UID: \"52b65981-f714-4678-bd2e-c80ac42f2244\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296249    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkjw\" (UniqueName: \"kubernetes.io/projected/066c3763-70d4-4496-9993-09cd26a2e18c-kube-api-access-twkjw\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296276    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-default-certificate\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v78m\" (UniqueName: \"kubernetes.io/projected/b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2-kube-api-access-8v78m\") pod \"network-check-source-7d88cb55d8-rh4gn\" (UID: \"b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b98624-56de-4710-b2cc-e4b4889f391d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bcb3f8a-3b1b-434b-bb58-791882b8b654-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296412    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-stats-auth\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296436    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ab3944-86e8-4a00-a136-381721b9d84d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79cf458db6-8p6qf\" (UID: \"51ab3944-86e8-4a00-a136-381721b9d84d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296482    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-image-registry-private-configuration\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d77639c8-4cde-4fbb-bfd9-6135d793d25d-config\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.297008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdcl\" (UniqueName: \"kubernetes.io/projected/23c0027b-a4e7-4939-8aaf-deda3a9ee484-kube-api-access-mmdcl\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296573    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qrm\" (UniqueName: \"kubernetes.io/projected/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-kube-api-access-x4qrm\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296594    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23c0027b-a4e7-4939-8aaf-deda3a9ee484-config-volume\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296665    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-hub\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.296688    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.296723    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.296752    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls podName:066c3763-70d4-4496-9993-09cd26a2e18c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:31.796735374 +0000 UTC m=+36.630978938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-z5nwx" (UID: "066c3763-70d4-4496-9993-09cd26a2e18c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.297305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b98624-56de-4710-b2cc-e4b4889f391d-config\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.297803 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.297548    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-certificates\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.298297 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.297937    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:45:31.298297 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.298059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-ca-trust-extracted\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.298297 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.298064    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d77639c8-4cde-4fbb-bfd9-6135d793d25d-trusted-ca\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.298297 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.298082    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-trusted-ca\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.298297 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.298244    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:45:31.298555 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.298533    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f872cb95-d3c5-4f9c-a22f-73dc88da028d-tmp\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.298607 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.298588    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bcb3f8a-3b1b-434b-bb58-791882b8b654-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.298760 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.298741    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f872cb95-d3c5-4f9c-a22f-73dc88da028d-service-ca-bundle\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.298893 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.298868    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:31.798847179 +0000 UTC m=+36.633090757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : secret "router-metrics-certs-default" not found
Jul 28 20:45:31.298975 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.298917    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert podName:f45b548f-b66e-472f-ab6a-8b9a27b4a6e6 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:31.798888279 +0000 UTC m=+36.633131844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-4mvzm" (UID: "f45b548f-b66e-472f-ab6a-8b9a27b4a6e6") : secret "networking-console-plugin-cert" not found
Jul 28 20:45:31.299045 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.298995    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:31.798987839 +0000 UTC m=+36.633231421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : configmap references non-existent config key: service-ca.crt
Jul 28 20:45:31.299122 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.299106    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:45:31.299179 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.299125    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866c8d54bc-s8zbn: secret "image-registry-tls" not found
Jul 28 20:45:31.299179 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.299171    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls podName:cfa08ae3-0777-47b2-8a4a-1627f28c6bd8 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:31.799155924 +0000 UTC m=+36.633399489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls") pod "image-registry-866c8d54bc-s8zbn" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8") : secret "image-registry-tls" not found
Jul 28 20:45:31.299284 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.299231    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-installation-pull-secrets\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.299552 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.299531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-bound-sa-token\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.299703 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.299686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82dr\" (UniqueName: \"kubernetes.io/projected/9bcb3f8a-3b1b-434b-bb58-791882b8b654-kube-api-access-w82dr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.299636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d77639c8-4cde-4fbb-bfd9-6135d793d25d-config\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.299895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.299967    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.299975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hznxf\" (UniqueName: \"kubernetes.io/projected/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-kube-api-access-hznxf\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b3e7e7-2c39-483b-93a7-fad9fef864e1-cert\") pod \"ingress-canary-g4gvn\" (UID: \"e7b3e7e7-2c39-483b-93a7-fad9fef864e1\") " pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.300204    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls podName:07249afe-c3d4-46e3-bc8d-7fb92081b7d1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:31.800077533 +0000 UTC m=+36.634321096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls") pod "cluster-samples-operator-6748489656-zh9xm" (UID: "07249afe-c3d4-46e3-bc8d-7fb92081b7d1") : secret "samples-operator-tls" not found
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f872cb95-d3c5-4f9c-a22f-73dc88da028d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d24rz\" (UniqueName: \"kubernetes.io/projected/f872cb95-d3c5-4f9c-a22f-73dc88da028d-kube-api-access-d24rz\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx79s\" (UniqueName: \"kubernetes.io/projected/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-kube-api-access-sx79s\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300453    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23c0027b-a4e7-4939-8aaf-deda3a9ee484-tmp-dir\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300514    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300538    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300567    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f872cb95-d3c5-4f9c-a22f-73dc88da028d-snapshots\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300595    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9phn\" (UniqueName: \"kubernetes.io/projected/abb747b6-437a-4157-aadb-855489061b3e-kube-api-access-x9phn\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.301048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f872cb95-d3c5-4f9c-a22f-73dc88da028d-serving-cert\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.301851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/066c3763-70d4-4496-9993-09cd26a2e18c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.301851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t8gj\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-kube-api-access-9t8gj\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.301851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.300812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23c0027b-a4e7-4939-8aaf-deda3a9ee484-tmp-dir\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.301851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.301142    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f872cb95-d3c5-4f9c-a22f-73dc88da028d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.301851 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.301248    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:45:31.301851 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.301291    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls podName:23c0027b-a4e7-4939-8aaf-deda3a9ee484 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:31.801275006 +0000 UTC m=+36.635518595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls") pod "dns-default-g4jxs" (UID: "23c0027b-a4e7-4939-8aaf-deda3a9ee484") : secret "dns-default-metrics-tls" not found
Jul 28 20:45:31.302152 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.302064    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:31.302551 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.302522    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f872cb95-d3c5-4f9c-a22f-73dc88da028d-snapshots\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.302551 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.302542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/066c3763-70d4-4496-9993-09cd26a2e18c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.303506 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.303405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-installation-pull-secrets\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.303506 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.303457    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bcb3f8a-3b1b-434b-bb58-791882b8b654-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.304014 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.303990    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d77639c8-4cde-4fbb-bfd9-6135d793d25d-serving-cert\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.304295 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.304274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b98624-56de-4710-b2cc-e4b4889f391d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.304851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.304438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-default-certificate\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.304851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.304797    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f872cb95-d3c5-4f9c-a22f-73dc88da028d-serving-cert\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.304851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.304826    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-image-registry-private-configuration\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.305889 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.305867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-stats-auth\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.307366 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.307346    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqpd2\" (UniqueName: \"kubernetes.io/projected/a7b98624-56de-4710-b2cc-e4b4889f391d-kube-api-access-fqpd2\") pod \"service-ca-operator-5d6c75f84f-rrm2t\" (UID: \"a7b98624-56de-4710-b2cc-e4b4889f391d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.309198 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.309177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkjw\" (UniqueName: \"kubernetes.io/projected/066c3763-70d4-4496-9993-09cd26a2e18c-kube-api-access-twkjw\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.321033 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.320976    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82dr\" (UniqueName: \"kubernetes.io/projected/9bcb3f8a-3b1b-434b-bb58-791882b8b654-kube-api-access-w82dr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-t592p\" (UID: \"9bcb3f8a-3b1b-434b-bb58-791882b8b654\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.321452 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.321429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qrm\" (UniqueName: \"kubernetes.io/projected/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-kube-api-access-x4qrm\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:31.321670 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.321554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d24rz\" (UniqueName: \"kubernetes.io/projected/f872cb95-d3c5-4f9c-a22f-73dc88da028d-kube-api-access-d24rz\") pod \"insights-operator-5885fdb759-dmh6c\" (UID: \"f872cb95-d3c5-4f9c-a22f-73dc88da028d\") " pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.322937 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.322905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwspb\" (UniqueName: \"kubernetes.io/projected/d77639c8-4cde-4fbb-bfd9-6135d793d25d-kube-api-access-bwspb\") pod \"console-operator-584dcb6b54-tbmzs\" (UID: \"d77639c8-4cde-4fbb-bfd9-6135d793d25d\") " pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.323063 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.323030    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-bound-sa-token\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.323317 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.323287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t8gj\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-kube-api-access-9t8gj\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.323514 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.323496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp65q\" (UniqueName: \"kubernetes.io/projected/52b65981-f714-4678-bd2e-c80ac42f2244-kube-api-access-zp65q\") pod \"volume-data-source-validator-549c6d54cf-jtcrb\" (UID: \"52b65981-f714-4678-bd2e-c80ac42f2244\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"
Jul 28 20:45:31.325191 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.325169    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdcl\" (UniqueName: \"kubernetes.io/projected/23c0027b-a4e7-4939-8aaf-deda3a9ee484-kube-api-access-mmdcl\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.327708 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.327684    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx79s\" (UniqueName: \"kubernetes.io/projected/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-kube-api-access-sx79s\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.368453 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.368418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:31.380484 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.380444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-dmh6c"
Jul 28 20:45:31.390667 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.390644    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"
Jul 28 20:45:31.399067 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.399037    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"
Jul 28 20:45:31.401439 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401405    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-ca\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.401575 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-tmp\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.401575 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v78m\" (UniqueName: \"kubernetes.io/projected/b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2-kube-api-access-8v78m\") pod \"network-check-source-7d88cb55d8-rh4gn\" (UID: \"b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"
Jul 28 20:45:31.401666 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401585    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ab3944-86e8-4a00-a136-381721b9d84d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79cf458db6-8p6qf\" (UID: \"51ab3944-86e8-4a00-a136-381721b9d84d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.401666 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-hub\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.401666 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401651    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.401845 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.401845 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hznxf\" (UniqueName: \"kubernetes.io/projected/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-kube-api-access-hznxf\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.401845 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401747    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b3e7e7-2c39-483b-93a7-fad9fef864e1-cert\") pod \"ingress-canary-g4gvn\" (UID: \"e7b3e7e7-2c39-483b-93a7-fad9fef864e1\") " pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.401845 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401769    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.402042 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401856    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9phn\" (UniqueName: \"kubernetes.io/projected/abb747b6-437a-4157-aadb-855489061b3e-kube-api-access-x9phn\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.402042 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc9dt\" (UniqueName: \"kubernetes.io/projected/51ab3944-86e8-4a00-a136-381721b9d84d-kube-api-access-cc9dt\") pod \"managed-serviceaccount-addon-agent-79cf458db6-8p6qf\" (UID: \"51ab3944-86e8-4a00-a136-381721b9d84d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.402042 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb747b6-437a-4157-aadb-855489061b3e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.402042 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.401945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbw6x\" (UniqueName: \"kubernetes.io/projected/e7b3e7e7-2c39-483b-93a7-fad9fef864e1-kube-api-access-lbw6x\") pod \"ingress-canary-g4gvn\" (UID: \"e7b3e7e7-2c39-483b-93a7-fad9fef864e1\") " pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.404176 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.403277    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-tmp\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.405753 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.405032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.405753 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.405410    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.405753 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.405698    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb747b6-437a-4157-aadb-855489061b3e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.405753 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.405726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-ca\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.407933 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.407837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b3e7e7-2c39-483b-93a7-fad9fef864e1-cert\") pod \"ingress-canary-g4gvn\" (UID: \"e7b3e7e7-2c39-483b-93a7-fad9fef864e1\") " pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.408661 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.408617    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-hub\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.409611 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.409586    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ab3944-86e8-4a00-a136-381721b9d84d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79cf458db6-8p6qf\" (UID: \"51ab3944-86e8-4a00-a136-381721b9d84d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.416518 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.416001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abb747b6-437a-4157-aadb-855489061b3e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.416660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.416586    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbw6x\" (UniqueName: \"kubernetes.io/projected/e7b3e7e7-2c39-483b-93a7-fad9fef864e1-kube-api-access-lbw6x\") pod \"ingress-canary-g4gvn\" (UID: \"e7b3e7e7-2c39-483b-93a7-fad9fef864e1\") " pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.419377 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.419348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9phn\" (UniqueName: \"kubernetes.io/projected/abb747b6-437a-4157-aadb-855489061b3e-kube-api-access-x9phn\") pod \"cluster-proxy-proxy-agent-7b7666f4df-xnqvc\" (UID: \"abb747b6-437a-4157-aadb-855489061b3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.419640 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.419615    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v78m\" (UniqueName: \"kubernetes.io/projected/b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2-kube-api-access-8v78m\") pod \"network-check-source-7d88cb55d8-rh4gn\" (UID: \"b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"
Jul 28 20:45:31.421363 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.421305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hznxf\" (UniqueName: \"kubernetes.io/projected/3fa9beed-5875-46e6-9ac3-3aae330e2a2c-kube-api-access-hznxf\") pod \"klusterlet-addon-workmgr-5cbc6bbc6-pdv7n\" (UID: \"3fa9beed-5875-46e6-9ac3-3aae330e2a2c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.421689 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.421665    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc9dt\" (UniqueName: \"kubernetes.io/projected/51ab3944-86e8-4a00-a136-381721b9d84d-kube-api-access-cc9dt\") pod \"managed-serviceaccount-addon-agent-79cf458db6-8p6qf\" (UID: \"51ab3944-86e8-4a00-a136-381721b9d84d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.435253 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.435214    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"
Jul 28 20:45:31.443156 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.443125    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:31.471205 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.470681    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:31.491703 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.491257    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"
Jul 28 20:45:31.505494 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.505267    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4gvn"
Jul 28 20:45:31.509022 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.508797    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"
Jul 28 20:45:31.518562 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.518279    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:31.527517 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.527281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:45:31.676477 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.659103    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb"]
Jul 28 20:45:31.712410 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.711391    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:45:31.716990 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.716216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:45:31.719956 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.718201    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:45:31.719956 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.719391    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:45:31.724826 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.724667    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p"]
Jul 28 20:45:31.725908 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.725832    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-dmh6c"]
Jul 28 20:45:31.727891 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.727694    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2qcwd\""
Jul 28 20:45:31.755046 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.754521    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-tbmzs"]
Jul 28 20:45:31.778633 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.778592    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t"]
Jul 28 20:45:31.808230 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.808049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:31.808230 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.808111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:31.808230 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.808177    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:31.808551 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.808521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.808663 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.808581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:31.808663 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.808613    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:32.808588241 +0000 UTC m=+37.642831811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : configmap references non-existent config key: service-ca.crt
Jul 28 20:45:31.808978 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.808959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:31.809059 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.809010    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:31.809288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809171    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:45:31.809288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809191    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866c8d54bc-s8zbn: secret "image-registry-tls" not found
Jul 28 20:45:31.809288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809204    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:45:31.809288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809244    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls podName:cfa08ae3-0777-47b2-8a4a-1627f28c6bd8 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:32.809226739 +0000 UTC m=+37.643470307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls") pod "image-registry-866c8d54bc-s8zbn" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8") : secret "image-registry-tls" not found
Jul 28 20:45:31.809288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809262    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert podName:f45b548f-b66e-472f-ab6a-8b9a27b4a6e6 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:32.809252171 +0000 UTC m=+37.643495735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-4mvzm" (UID: "f45b548f-b66e-472f-ab6a-8b9a27b4a6e6") : secret "networking-console-plugin-cert" not found
Jul 28 20:45:31.809288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809284    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:45:31.809970 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809322    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:32.809305348 +0000 UTC m=+37.643548914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : secret "router-metrics-certs-default" not found
Jul 28 20:45:31.809970 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809362    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:45:31.809970 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809397    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls podName:23c0027b-a4e7-4939-8aaf-deda3a9ee484 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:32.809385244 +0000 UTC m=+37.643628814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls") pod "dns-default-g4jxs" (UID: "23c0027b-a4e7-4939-8aaf-deda3a9ee484") : secret "dns-default-metrics-tls" not found
Jul 28 20:45:31.809970 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809443    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:31.809970 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809480    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls podName:066c3763-70d4-4496-9993-09cd26a2e18c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:32.809468747 +0000 UTC m=+37.643712316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-z5nwx" (UID: "066c3763-70d4-4496-9993-09cd26a2e18c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:31.809970 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809549    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:45:31.809970 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:31.809588    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls podName:07249afe-c3d4-46e3-bc8d-7fb92081b7d1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:32.809574572 +0000 UTC m=+37.643818139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls") pod "cluster-samples-operator-6748489656-zh9xm" (UID: "07249afe-c3d4-46e3-bc8d-7fb92081b7d1") : secret "samples-operator-tls" not found
Jul 28 20:45:31.822241 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.822190    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf"]
Jul 28 20:45:31.851455 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.851428    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn"]
Jul 28 20:45:31.859632 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.859606    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4gvn"]
Jul 28 20:45:31.869477 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.869441    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"]
Jul 28 20:45:31.877286 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:31.877258    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"]
Jul 28 20:45:32.711315 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.711279    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:45:32.714259 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.714229    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5747k\""
Jul 28 20:45:32.820161 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.820121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:32.820350 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.820177    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:32.820350 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.820232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:32.820350 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.820272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:32.820350 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820317    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:34.820293403 +0000 UTC m=+39.654536991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : configmap references non-existent config key: service-ca.crt
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.820354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820368    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820374    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820391    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866c8d54bc-s8zbn: secret "image-registry-tls" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.820392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820368    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820423    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:34.820406481 +0000 UTC m=+39.654650068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : secret "router-metrics-certs-default" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820453    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls podName:cfa08ae3-0777-47b2-8a4a-1627f28c6bd8 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:34.820443002 +0000 UTC m=+39.654686609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls") pod "image-registry-866c8d54bc-s8zbn" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8") : secret "image-registry-tls" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820463    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820463    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820471    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert podName:f45b548f-b66e-472f-ab6a-8b9a27b4a6e6 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:34.820462941 +0000 UTC m=+39.654706510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-4mvzm" (UID: "f45b548f-b66e-472f-ab6a-8b9a27b4a6e6") : secret "networking-console-plugin-cert" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820505    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls podName:07249afe-c3d4-46e3-bc8d-7fb92081b7d1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:34.82049235 +0000 UTC m=+39.654735916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls") pod "cluster-samples-operator-6748489656-zh9xm" (UID: "07249afe-c3d4-46e3-bc8d-7fb92081b7d1") : secret "samples-operator-tls" not found
Jul 28 20:45:32.820586 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820554    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls podName:066c3763-70d4-4496-9993-09cd26a2e18c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:34.82052452 +0000 UTC m=+39.654768090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-z5nwx" (UID: "066c3763-70d4-4496-9993-09cd26a2e18c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:32.821110 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:32.820600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:32.821110 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820675    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:45:32.821110 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:32.820705    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls podName:23c0027b-a4e7-4939-8aaf-deda3a9ee484 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:34.820694715 +0000 UTC m=+39.654938279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls") pod "dns-default-g4jxs" (UID: "23c0027b-a4e7-4939-8aaf-deda3a9ee484") : secret "dns-default-metrics-tls" not found
Jul 28 20:45:33.285567 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:45:33.285533    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b98624_56de_4710_b2cc_e4b4889f391d.slice/crio-e8780ad334bf77c76952d0c5733149cdc42ec905ceec0e89ed056c4c2fabf4cf WatchSource:0}: Error finding container e8780ad334bf77c76952d0c5733149cdc42ec905ceec0e89ed056c4c2fabf4cf: Status 404 returned error can't find the container with id e8780ad334bf77c76952d0c5733149cdc42ec905ceec0e89ed056c4c2fabf4cf
Jul 28 20:45:33.286031 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:45:33.285996    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77639c8_4cde_4fbb_bfd9_6135d793d25d.slice/crio-5751ef636012aa75cbcc2f4049a56fa0a088c369134e3b1701a0b256d2a883fe WatchSource:0}: Error finding container 5751ef636012aa75cbcc2f4049a56fa0a088c369134e3b1701a0b256d2a883fe: Status 404 returned error can't find the container with id 5751ef636012aa75cbcc2f4049a56fa0a088c369134e3b1701a0b256d2a883fe
Jul 28 20:45:33.286987 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:45:33.286957    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51ab3944_86e8_4a00_a136_381721b9d84d.slice/crio-29000f9bab6593720136ed36714564823d67040ee09954597e68c2f0b0896e84 WatchSource:0}: Error finding container 29000f9bab6593720136ed36714564823d67040ee09954597e68c2f0b0896e84: Status 404 returned error can't find the container with id 29000f9bab6593720136ed36714564823d67040ee09954597e68c2f0b0896e84
Jul 28 20:45:33.288851 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:45:33.287859    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf872cb95_d3c5_4f9c_a22f_73dc88da028d.slice/crio-d336113d5ee58214cbfd29dfe8ad97682afa7e19a9668d4035992ebb671b4dda WatchSource:0}: Error finding container d336113d5ee58214cbfd29dfe8ad97682afa7e19a9668d4035992ebb671b4dda: Status 404 returned error can't find the container with id d336113d5ee58214cbfd29dfe8ad97682afa7e19a9668d4035992ebb671b4dda
Jul 28 20:45:33.291763 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:45:33.291341    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb134ad0e_4ed0_4ea7_9cd7_40d06c38ccc2.slice/crio-399d5a193f7d9789b90b3490953745158e1f547dbcf7338415e2770b1d21b26d WatchSource:0}: Error finding container 399d5a193f7d9789b90b3490953745158e1f547dbcf7338415e2770b1d21b26d: Status 404 returned error can't find the container with id 399d5a193f7d9789b90b3490953745158e1f547dbcf7338415e2770b1d21b26d
Jul 28 20:45:33.299643 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:45:33.297566    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcb3f8a_3b1b_434b_bb58_791882b8b654.slice/crio-b84dd5b135e8d680a4489ceb82d15f943a0688f8f9bce3231d9707b12dc7f884 WatchSource:0}: Error finding container b84dd5b135e8d680a4489ceb82d15f943a0688f8f9bce3231d9707b12dc7f884: Status 404 returned error can't find the container with id b84dd5b135e8d680a4489ceb82d15f943a0688f8f9bce3231d9707b12dc7f884
Jul 28 20:45:33.977060 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.976984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4gvn" event={"ID":"e7b3e7e7-2c39-483b-93a7-fad9fef864e1","Type":"ContainerStarted","Data":"2de53318bfab9201df070799ca4786bcf8df8cf0afc8a4305227b87eda298186"}
Jul 28 20:45:33.979683 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.979646    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t" event={"ID":"a7b98624-56de-4710-b2cc-e4b4889f391d","Type":"ContainerStarted","Data":"e8780ad334bf77c76952d0c5733149cdc42ec905ceec0e89ed056c4c2fabf4cf"}
Jul 28 20:45:33.981979 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.981949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n" event={"ID":"3fa9beed-5875-46e6-9ac3-3aae330e2a2c","Type":"ContainerStarted","Data":"16f19a76a870424b6959d0ef42a223774f8edce16b9d416402076a7e685cb77a"}
Jul 28 20:45:33.985461 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.985435    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" event={"ID":"abb747b6-437a-4157-aadb-855489061b3e","Type":"ContainerStarted","Data":"e6d8cd4669ecb729c129f66b237f1e112d3e6d16c45f65b9ea9abdf712d3738f"}
Jul 28 20:45:33.989239 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.989148    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn" event={"ID":"b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2","Type":"ContainerStarted","Data":"399d5a193f7d9789b90b3490953745158e1f547dbcf7338415e2770b1d21b26d"}
Jul 28 20:45:33.991323 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.991295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p" event={"ID":"9bcb3f8a-3b1b-434b-bb58-791882b8b654","Type":"ContainerStarted","Data":"b84dd5b135e8d680a4489ceb82d15f943a0688f8f9bce3231d9707b12dc7f884"}
Jul 28 20:45:33.993138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.993110    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf" event={"ID":"51ab3944-86e8-4a00-a136-381721b9d84d","Type":"ContainerStarted","Data":"29000f9bab6593720136ed36714564823d67040ee09954597e68c2f0b0896e84"}
Jul 28 20:45:33.994870 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.994845    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dmh6c" event={"ID":"f872cb95-d3c5-4f9c-a22f-73dc88da028d","Type":"ContainerStarted","Data":"d336113d5ee58214cbfd29dfe8ad97682afa7e19a9668d4035992ebb671b4dda"}
Jul 28 20:45:33.999910 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.999883    2572 generic.go:356] "Generic (PLEG): container finished" podID="ebaec2da-39eb-45df-ad77-b4e10c7705e4" containerID="437e72a9eae1d9ec02db8f2ab6a148e6a87f3a85e1895af2afc2ce39271eb9ef" exitCode=0
Jul 28 20:45:34.000043 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:33.999957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerDied","Data":"437e72a9eae1d9ec02db8f2ab6a148e6a87f3a85e1895af2afc2ce39271eb9ef"}
Jul 28 20:45:34.015515 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.015477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" event={"ID":"d77639c8-4cde-4fbb-bfd9-6135d793d25d","Type":"ContainerStarted","Data":"5751ef636012aa75cbcc2f4049a56fa0a088c369134e3b1701a0b256d2a883fe"}
Jul 28 20:45:34.017527 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.017495    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb" event={"ID":"52b65981-f714-4678-bd2e-c80ac42f2244","Type":"ContainerStarted","Data":"b9514206d9fbef7bc29fd4c590dbdbf736711204b09130a05edbd47cbc83a5f7"}
Jul 28 20:45:34.597848 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.597745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:34.694171 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.694095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:34.843941 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.843898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:34.844122 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.844008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:34.844122 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.844046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:34.844122 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.844100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:34.844231 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.844212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:34.844297 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.844260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:34.844331 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.844299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:34.844463 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844446    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:45:34.844530 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844515    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls podName:07249afe-c3d4-46e3-bc8d-7fb92081b7d1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:38.844495256 +0000 UTC m=+43.678738824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls") pod "cluster-samples-operator-6748489656-zh9xm" (UID: "07249afe-c3d4-46e3-bc8d-7fb92081b7d1") : secret "samples-operator-tls" not found
Jul 28 20:45:34.844605 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844591    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:45:34.844659 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844630    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls podName:23c0027b-a4e7-4939-8aaf-deda3a9ee484 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:38.844618497 +0000 UTC m=+43.678862061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls") pod "dns-default-g4jxs" (UID: "23c0027b-a4e7-4939-8aaf-deda3a9ee484") : secret "dns-default-metrics-tls" not found
Jul 28 20:45:34.844723 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844711    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:38.844699927 +0000 UTC m=+43.678943496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : configmap references non-existent config key: service-ca.crt
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844795    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844833    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert podName:f45b548f-b66e-472f-ab6a-8b9a27b4a6e6 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:38.844822107 +0000 UTC m=+43.679065670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-4mvzm" (UID: "f45b548f-b66e-472f-ab6a-8b9a27b4a6e6") : secret "networking-console-plugin-cert" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844925    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844981    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844996    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:38.84497914 +0000 UTC m=+43.679222707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : secret "router-metrics-certs-default" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.844930    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.845023    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866c8d54bc-s8zbn: secret "image-registry-tls" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.845033    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls podName:066c3763-70d4-4496-9993-09cd26a2e18c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:38.845018405 +0000 UTC m=+43.679261972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-z5nwx" (UID: "066c3763-70d4-4496-9993-09cd26a2e18c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:34.845206 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:34.845063    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls podName:cfa08ae3-0777-47b2-8a4a-1627f28c6bd8 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:38.845052743 +0000 UTC m=+43.679296323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls") pod "image-registry-866c8d54bc-s8zbn" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8") : secret "image-registry-tls" not found
Jul 28 20:45:34.899171 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:34.899091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:35.041329 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:35.041287    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:35.057497 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:35.056479    2572 generic.go:356] "Generic (PLEG): container finished" podID="ebaec2da-39eb-45df-ad77-b4e10c7705e4" containerID="799887a75238fda7679cc3b4f757981b8b43cd208e9ea52f0264b0e1bb9fff2c" exitCode=0
Jul 28 20:45:35.057497 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:35.056569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerDied","Data":"799887a75238fda7679cc3b4f757981b8b43cd208e9ea52f0264b0e1bb9fff2c"}
Jul 28 20:45:35.137748 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:35.136747    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:35.808728 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:35.808426    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:36.108046 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:36.108000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49799" event={"ID":"ebaec2da-39eb-45df-ad77-b4e10c7705e4","Type":"ContainerStarted","Data":"0abcaf96e851ba1a3e4ca67af92ea6c893ecec9f11d388772e2d803dcc6bb850"}
Jul 28 20:45:36.560903 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:36.558059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:36.639624 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:36.639587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:37.117121 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:37.117015    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb" event={"ID":"52b65981-f714-4678-bd2e-c80ac42f2244","Type":"ContainerStarted","Data":"b4db17c3cce5bb9708fd68e56070c62e61a58626f2ab12262e23bce838bfa273"}
Jul 28 20:45:37.138303 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:37.137813    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jtcrb" podStartSLOduration=30.410096066 podStartE2EDuration="33.137772509s" totalImagesPullingTime="2.727676443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:37.135069527 +0000 UTC m=+41.969313130" watchObservedRunningTime="2026-07-28 20:45:37.137772509 +0000 UTC m=+41.972016096"
Jul 28 20:45:37.138303 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:37.138027    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-49799" podStartSLOduration=10.067156323 podStartE2EDuration="41.138018531s" totalImagesPullingTime="31.070862208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:36.142979781 +0000 UTC m=+40.977223368" watchObservedRunningTime="2026-07-28 20:45:37.138018531 +0000 UTC m=+41.972262130"
Jul 28 20:45:37.272625 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:37.272515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:37.351964 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:37.351926    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:38.746599 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.746502    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:38.900127 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.900094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.900148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.900185    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.900209    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.900256    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900326    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.900332    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900337    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900360    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866c8d54bc-s8zbn: secret "image-registry-tls" not found
Jul 28 20:45:38.900380 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900377    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900328    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900397    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900411    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:46.900379813 +0000 UTC m=+51.734623384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : secret "router-metrics-certs-default" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900427    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900441    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls podName:cfa08ae3-0777-47b2-8a4a-1627f28c6bd8 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:46.900431029 +0000 UTC m=+51.734674598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls") pod "image-registry-866c8d54bc-s8zbn" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8") : secret "image-registry-tls" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900462    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert podName:f45b548f-b66e-472f-ab6a-8b9a27b4a6e6 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:46.900452151 +0000 UTC m=+51.734695716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-4mvzm" (UID: "f45b548f-b66e-472f-ab6a-8b9a27b4a6e6") : secret "networking-console-plugin-cert" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900480    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls podName:066c3763-70d4-4496-9993-09cd26a2e18c nodeName:}" failed. No retries permitted until 2026-07-28 20:45:46.90047487 +0000 UTC m=+51.734718435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-z5nwx" (UID: "066c3763-70d4-4496-9993-09cd26a2e18c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900492    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls podName:07249afe-c3d4-46e3-bc8d-7fb92081b7d1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:46.900487544 +0000 UTC m=+51.734731109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls") pod "cluster-samples-operator-6748489656-zh9xm" (UID: "07249afe-c3d4-46e3-bc8d-7fb92081b7d1") : secret "samples-operator-tls" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900502    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls podName:23c0027b-a4e7-4939-8aaf-deda3a9ee484 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:46.900498053 +0000 UTC m=+51.734741618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls") pod "dns-default-g4jxs" (UID: "23c0027b-a4e7-4939-8aaf-deda3a9ee484") : secret "dns-default-metrics-tls" not found
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:38.900544    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:38.900693 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:38.900669    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:46.900660367 +0000 UTC m=+51.734903930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : configmap references non-existent config key: service-ca.crt
Jul 28 20:45:41.117741 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:41.117663    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:41.219409 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:41.219372    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:45.442656 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:45.442565    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:45.511549 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:45.511514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:46.312023 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.311979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:46.980962 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.980924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.980993    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.981024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.981058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981082    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981151    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls podName:23c0027b-a4e7-4939-8aaf-deda3a9ee484 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:02.981134175 +0000 UTC m=+67.815377740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls") pod "dns-default-g4jxs" (UID: "23c0027b-a4e7-4939-8aaf-deda3a9ee484") : secret "dns-default-metrics-tls" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981151    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.981087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981178    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981183    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:02.98116324 +0000 UTC m=+67.815406825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : configmap references non-existent config key: service-ca.crt
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981246    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs podName:fe6d8528-3f55-46bd-b0ff-ad963b8a46f1 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:02.981236066 +0000 UTC m=+67.815479630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs") pod "router-default-ff76cddc9-wcv8g" (UID: "fe6d8528-3f55-46bd-b0ff-ad963b8a46f1") : secret "router-metrics-certs-default" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981259    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981264    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert podName:f45b548f-b66e-472f-ab6a-8b9a27b4a6e6 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:02.981254918 +0000 UTC m=+67.815498483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-4mvzm" (UID: "f45b548f-b66e-472f-ab6a-8b9a27b4a6e6") : secret "networking-console-plugin-cert" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981276    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866c8d54bc-s8zbn: secret "image-registry-tls" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.981312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981333    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls podName:cfa08ae3-0777-47b2-8a4a-1627f28c6bd8 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:02.981317655 +0000 UTC m=+67.815561235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls") pod "image-registry-866c8d54bc-s8zbn" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8") : secret "image-registry-tls" not found
Jul 28 20:45:46.981348 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981354    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:46.981863 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981375    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls podName:066c3763-70d4-4496-9993-09cd26a2e18c nodeName:}" failed. No retries permitted until 2026-07-28 20:46:02.9813695 +0000 UTC m=+67.815613063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-z5nwx" (UID: "066c3763-70d4-4496-9993-09cd26a2e18c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:45:46.981863 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:46.981373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:45:46.981863 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981466    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:45:46.981863 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:46.981507    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls podName:07249afe-c3d4-46e3-bc8d-7fb92081b7d1 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:02.981496971 +0000 UTC m=+67.815740543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls") pod "cluster-samples-operator-6748489656-zh9xm" (UID: "07249afe-c3d4-46e3-bc8d-7fb92081b7d1") : secret "samples-operator-tls" not found
Jul 28 20:45:48.158482 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.158444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4gvn" event={"ID":"e7b3e7e7-2c39-483b-93a7-fad9fef864e1","Type":"ContainerStarted","Data":"34f4ef7f1c59a0cb49b882703a8c40ec0381273b815d37f3fa7ce761f9ff7008"}
Jul 28 20:45:48.162161 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.161065    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t" event={"ID":"a7b98624-56de-4710-b2cc-e4b4889f391d","Type":"ContainerStarted","Data":"97cca8412770ecef7c8f8b5cb246b8d1a0c6e266999a76d6be8b44a0bd7dcb0e"}
Jul 28 20:45:48.163338 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.163308    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n" event={"ID":"3fa9beed-5875-46e6-9ac3-3aae330e2a2c","Type":"ContainerStarted","Data":"7989da67464126dde538f11d4503263c9782492b0aab608d470557cccc0ea395"}
Jul 28 20:45:48.163932 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.163911    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:48.165990 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.165948    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" event={"ID":"abb747b6-437a-4157-aadb-855489061b3e","Type":"ContainerStarted","Data":"8b268ff75bf98d42e20c9491b03609deed0ee82c7990ccc07849c21862263cac"}
Jul 28 20:45:48.166117 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.165998    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" event={"ID":"abb747b6-437a-4157-aadb-855489061b3e","Type":"ContainerStarted","Data":"202e965a957e8028274471e2876d607cd4ad16d9f8e96c8f6a84c4d2e9b32be3"}
Jul 28 20:45:48.166117 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.166016    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" event={"ID":"abb747b6-437a-4157-aadb-855489061b3e","Type":"ContainerStarted","Data":"d850997ad7329a1732bbbc8dda531fd0034343e4d665a774337e5f0a7f02bf94"}
Jul 28 20:45:48.166117 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.166063    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n"
Jul 28 20:45:48.167933 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.167903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn" event={"ID":"b134ad0e-4ed0-4ea7-9cd7-40d06c38ccc2","Type":"ContainerStarted","Data":"eefd48c5dd470d017995ff94013d0a7d87c270dd1b56a2752ae577e04ecf5910"}
Jul 28 20:45:48.169474 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.169453    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p" event={"ID":"9bcb3f8a-3b1b-434b-bb58-791882b8b654","Type":"ContainerStarted","Data":"d6a2e25a38821d7fc46e1e52146caa62a012ba56b70145eb669bb8e9bb08fab8"}
Jul 28 20:45:48.171044 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.171016    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf" event={"ID":"51ab3944-86e8-4a00-a136-381721b9d84d","Type":"ContainerStarted","Data":"1ab82ef1d364c9a3db2b06eb647d033bfdd4373a42fb46384c591bfa7cc41a04"}
Jul 28 20:45:48.172680 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.172505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dmh6c" event={"ID":"f872cb95-d3c5-4f9c-a22f-73dc88da028d","Type":"ContainerStarted","Data":"257a57908e9d33dea522666705de467caf73f8954a4c077b5e079d5506653f00"}
Jul 28 20:45:48.174396 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.174374    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/0.log"
Jul 28 20:45:48.174503 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.174407    2572 generic.go:356] "Generic (PLEG): container finished" podID="d77639c8-4cde-4fbb-bfd9-6135d793d25d" containerID="bf10b8d6480c5caec0c9618432e5ce5857ba518946fd12ae88a83c0813431666" exitCode=255
Jul 28 20:45:48.174503 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.174434    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" event={"ID":"d77639c8-4cde-4fbb-bfd9-6135d793d25d","Type":"ContainerDied","Data":"bf10b8d6480c5caec0c9618432e5ce5857ba518946fd12ae88a83c0813431666"}
Jul 28 20:45:48.174658 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.174644    2572 scope.go:117] "RemoveContainer" containerID="bf10b8d6480c5caec0c9618432e5ce5857ba518946fd12ae88a83c0813431666"
Jul 28 20:45:48.180945 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.180894    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g4gvn" podStartSLOduration=3.307844557 podStartE2EDuration="17.180876152s" totalImagesPullingTime="13.873031595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.179385587 +0000 UTC m=+53.013629185" watchObservedRunningTime="2026-07-28 20:45:48.180876152 +0000 UTC m=+53.015119735"
Jul 28 20:45:48.229070 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.228537    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-dmh6c" podStartSLOduration=30.372270033 podStartE2EDuration="44.228513413s" totalImagesPullingTime="13.85624338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.227045876 +0000 UTC m=+53.061289465" watchObservedRunningTime="2026-07-28 20:45:48.228513413 +0000 UTC m=+53.062756998"
Jul 28 20:45:48.235852 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.235754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:48.252660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.252606    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79cf458db6-8p6qf" podStartSLOduration=7.361631507 podStartE2EDuration="21.252586138s" totalImagesPullingTime="13.890954631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.252186107 +0000 UTC m=+53.086429694" watchObservedRunningTime="2026-07-28 20:45:48.252586138 +0000 UTC m=+53.086829725"
Jul 28 20:45:48.275064 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.275005    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rh4gn" podStartSLOduration=30.424032143 podStartE2EDuration="44.274983018s" totalImagesPullingTime="13.850950875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.274357861 +0000 UTC m=+53.108601446" watchObservedRunningTime="2026-07-28 20:45:48.274983018 +0000 UTC m=+53.109226605"
Jul 28 20:45:48.295334 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.295277    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbc6bbc6-pdv7n" podStartSLOduration=7.44691072 podStartE2EDuration="21.295258391s" totalImagesPullingTime="13.848347671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.295152973 +0000 UTC m=+53.129396562" watchObservedRunningTime="2026-07-28 20:45:48.295258391 +0000 UTC m=+53.129501978"
Jul 28 20:45:48.318277 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.318211    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t" podStartSLOduration=30.459769327 podStartE2EDuration="44.31819004s" totalImagesPullingTime="13.858420713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.317720621 +0000 UTC m=+53.151964207" watchObservedRunningTime="2026-07-28 20:45:48.31819004 +0000 UTC m=+53.152433627"
Jul 28 20:45:48.320198 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.320169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:48.370438 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.370376    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" podStartSLOduration=7.492952508 podStartE2EDuration="21.370352926s" totalImagesPullingTime="13.877400418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.369802796 +0000 UTC m=+53.204046379" watchObservedRunningTime="2026-07-28 20:45:48.370352926 +0000 UTC m=+53.204596514"
Jul 28 20:45:48.371322 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.371283    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p" podStartSLOduration=30.550631704 podStartE2EDuration="44.371271879s" totalImagesPullingTime="13.820640175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:48.345369077 +0000 UTC m=+53.179612666" watchObservedRunningTime="2026-07-28 20:45:48.371271879 +0000 UTC m=+53.205515464"
Jul 28 20:45:48.721991 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.721958    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2j6wh"]
Jul 28 20:45:48.742172 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.742136    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2j6wh"]
Jul 28 20:45:48.742378 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.742293    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.745962 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.745937    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nwhvj\""
Jul 28 20:45:48.746163 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.746145    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 20:45:48.746342 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.746316    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 20:45:48.753542 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.752992    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:48.805863 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.805810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.805863 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.805861    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47466a8c-0bbb-483e-bcf4-7bed1250f202-data-volume\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.806079 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.805943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.806079 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.806023    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47466a8c-0bbb-483e-bcf4-7bed1250f202-crio-socket\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.806152 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.806078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5g6v\" (UniqueName: \"kubernetes.io/projected/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-api-access-x5g6v\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.874393 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.874353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:48.907473 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.907434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.907473 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.907480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47466a8c-0bbb-483e-bcf4-7bed1250f202-data-volume\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.907526    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.907576    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47466a8c-0bbb-483e-bcf4-7bed1250f202-crio-socket\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:48.907580    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.907650    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47466a8c-0bbb-483e-bcf4-7bed1250f202-crio-socket\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:48.907659    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:49.407636728 +0000 UTC m=+54.241880306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : configmap "kube-rbac-proxy" not found
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:48.907689    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.907726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5g6v\" (UniqueName: \"kubernetes.io/projected/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-api-access-x5g6v\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.907747 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:48.907745    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:49.407727431 +0000 UTC m=+54.241971007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:48.908143 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.908004    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47466a8c-0bbb-483e-bcf4-7bed1250f202-data-volume\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:48.918323 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:48.918287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5g6v\" (UniqueName: \"kubernetes.io/projected/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-api-access-x5g6v\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:49.181174 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.181144    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:45:49.181621 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.181606    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/0.log"
Jul 28 20:45:49.181665 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.181646    2572 generic.go:356] "Generic (PLEG): container finished" podID="d77639c8-4cde-4fbb-bfd9-6135d793d25d" containerID="90bf5140f0f738d417408b7d72fa55b4a06f2f7dab15a6003b9b694444ecf08f" exitCode=255
Jul 28 20:45:49.181812 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.181759    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" event={"ID":"d77639c8-4cde-4fbb-bfd9-6135d793d25d","Type":"ContainerDied","Data":"90bf5140f0f738d417408b7d72fa55b4a06f2f7dab15a6003b9b694444ecf08f"}
Jul 28 20:45:49.181912 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.181835    2572 scope.go:117] "RemoveContainer" containerID="bf10b8d6480c5caec0c9618432e5ce5857ba518946fd12ae88a83c0813431666"
Jul 28 20:45:49.182118 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.182074    2572 scope.go:117] "RemoveContainer" containerID="90bf5140f0f738d417408b7d72fa55b4a06f2f7dab15a6003b9b694444ecf08f"
Jul 28 20:45:49.182326 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:49.182301    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-tbmzs_openshift-console-operator(d77639c8-4cde-4fbb-bfd9-6135d793d25d)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" podUID="d77639c8-4cde-4fbb-bfd9-6135d793d25d"
Jul 28 20:45:49.415799 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.415743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:49.416020 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.415821    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:49.416020 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:49.415883    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:45:49.416020 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:49.415930    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:49.416020 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:49.415964    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:50.41594792 +0000 UTC m=+55.250191484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : configmap "kube-rbac-proxy" not found
Jul 28 20:45:49.416020 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:49.416007    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:50.415980831 +0000 UTC m=+55.250224399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:49.807542 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.807507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:49.912449 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:49.912404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:50.011771 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.011732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:50.087980 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.087894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:50.187427 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.187398    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:45:50.187930 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.187735    2572 scope.go:117] "RemoveContainer" containerID="90bf5140f0f738d417408b7d72fa55b4a06f2f7dab15a6003b9b694444ecf08f"
Jul 28 20:45:50.187930 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:50.187897    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-tbmzs_openshift-console-operator(d77639c8-4cde-4fbb-bfd9-6135d793d25d)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" podUID="d77639c8-4cde-4fbb-bfd9-6135d793d25d"
Jul 28 20:45:50.278303 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.278260    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:50.347370 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.347266    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:50.426796 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.426737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:50.426972 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.426838    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:50.426972 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:50.426862    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:45:50.426972 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:50.426931    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:52.426904464 +0000 UTC m=+57.261148051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : configmap "kube-rbac-proxy" not found
Jul 28 20:45:50.427085 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:50.426981    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:50.427085 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:50.427045    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:52.427029505 +0000 UTC m=+57.261273075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:50.503650 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.503619    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nw5c_d749b6ec-d33e-4b20-8d22-5f332ac2d721/dns-node-resolver/0.log"
Jul 28 20:45:50.546726 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.546690    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:50.641256 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:50.641228    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:51.443748 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:51.443704    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:51.444187 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:51.443769    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:45:51.444187 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:51.444124    2572 scope.go:117] "RemoveContainer" containerID="90bf5140f0f738d417408b7d72fa55b4a06f2f7dab15a6003b9b694444ecf08f"
Jul 28 20:45:51.444288 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:51.444269    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-tbmzs_openshift-console-operator(d77639c8-4cde-4fbb-bfd9-6135d793d25d)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" podUID="d77639c8-4cde-4fbb-bfd9-6135d793d25d"
Jul 28 20:45:51.894615 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:51.894588    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fzprj_9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab/node-ca/0.log"
Jul 28 20:45:51.910920 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:51.910887    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:52.009874 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:52.009845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:52.184013 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:52.183902    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:52.252528 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:52.252482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:52.447621 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:52.447524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:52.447621 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:52.447582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:52.448088 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:52.447651    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:45:52.448088 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:52.447725    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:56.447708362 +0000 UTC m=+61.281951946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : configmap "kube-rbac-proxy" not found
Jul 28 20:45:52.448088 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:52.447742    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:52.448088 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:52.447821    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:45:56.44780728 +0000 UTC m=+61.282050844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:52.500396 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:52.500370    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4gvn_e7b3e7e7-2c39-483b-93a7-fad9fef864e1/serve-healthcheck-canary/0.log"
Jul 28 20:45:53.211166 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:53.211123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:55.890955 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:55.890915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:56.169072 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.168981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:56.266139 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.266087    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:56.366552 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.366518    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:56.468037 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.467956    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:56.483886 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.483850    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:56.484093 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.483897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:45:56.484093 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:56.483994    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:45:56.484093 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:56.484010    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:56.484093 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:56.484072    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:04.48405875 +0000 UTC m=+69.318302314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:45:56.484315 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:45:56.484152    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:04.484126515 +0000 UTC m=+69.318370083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : configmap "kube-rbac-proxy" not found
Jul 28 20:45:56.589465 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.589421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:56.971808 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:56.971744    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwqf"
Jul 28 20:45:57.593371 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:57.593338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:57.788184 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:57.788153    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:58.184605 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:58.184568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:58.387156 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:58.387116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:58.791868 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:58.791829    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:59.387551 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:59.387521    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:59.760394 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:59.760311    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:45:59.843102 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:45:59.843035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:00.197024 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:00.196988    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:00.389764 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:00.389725    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:00.477424 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:00.477308    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:00.788722 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:00.788635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:01.434248 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.434212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:46:01.434660 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.434331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:46:01.437304 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.437282    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:46:01.437420 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.437285    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:46:01.445195 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:46:01.445168    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 20:46:01.445259 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:46:01.445240    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs podName:2ac58d4c-790e-4d2e-bd81-376067877ce0 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:05.445219111 +0000 UTC m=+130.279462676 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs") pod "network-metrics-daemon-b6hg6" (UID: "2ac58d4c-790e-4d2e-bd81-376067877ce0") : secret "metrics-daemon-secret" not found
Jul 28 20:46:01.447564 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.447533    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24d41e59-b89c-4178-91b2-af1dc84e86ed-original-pull-secret\") pod \"global-pull-secret-syncer-5chvb\" (UID: \"24d41e59-b89c-4178-91b2-af1dc84e86ed\") " pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:46:01.480008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.479968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5chvb"
Jul 28 20:46:01.535308 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.535190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:46:01.538754 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.538714    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn86p\" (UniqueName: \"kubernetes.io/projected/2eec7a43-59be-454d-8426-2e9269637c7c-kube-api-access-xn86p\") pod \"network-check-target-v7znx\" (UID: \"2eec7a43-59be-454d-8426-2e9269637c7c\") " pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:46:01.593798 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.593756    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:01.616996 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.616972    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5chvb"]
Jul 28 20:46:01.619504 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:01.619477    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d41e59_b89c_4178_91b2_af1dc84e86ed.slice/crio-2498e4e8b20c22f338aa644f2f454532d48d14737c257fdc6f291f5808e8e8d1 WatchSource:0}: Error finding container 2498e4e8b20c22f338aa644f2f454532d48d14737c257fdc6f291f5808e8e8d1: Status 404 returned error can't find the container with id 2498e4e8b20c22f338aa644f2f454532d48d14737c257fdc6f291f5808e8e8d1
Jul 28 20:46:01.785309 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.785219    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:01.825137 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.825105    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5747k\""
Jul 28 20:46:01.832653 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.832629    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:46:01.976994 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:01.976968    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v7znx"]
Jul 28 20:46:01.979309 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:01.979282    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eec7a43_59be_454d_8426_2e9269637c7c.slice/crio-392a27b650349d1147ae600c6a2ce79bbd6debcf5119595e555dd1f14b2bd26c WatchSource:0}: Error finding container 392a27b650349d1147ae600c6a2ce79bbd6debcf5119595e555dd1f14b2bd26c: Status 404 returned error can't find the container with id 392a27b650349d1147ae600c6a2ce79bbd6debcf5119595e555dd1f14b2bd26c
Jul 28 20:46:02.182611 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.182579    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:02.228285 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.228242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5chvb" event={"ID":"24d41e59-b89c-4178-91b2-af1dc84e86ed","Type":"ContainerStarted","Data":"2498e4e8b20c22f338aa644f2f454532d48d14737c257fdc6f291f5808e8e8d1"}
Jul 28 20:46:02.230182 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.230146    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v7znx" event={"ID":"2eec7a43-59be-454d-8426-2e9269637c7c","Type":"ContainerStarted","Data":"245b606fd17329b8f61d42fed293642b32c212eacb86c78e0358f621c99b9d6f"}
Jul 28 20:46:02.230330 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.230199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v7znx" event={"ID":"2eec7a43-59be-454d-8426-2e9269637c7c","Type":"ContainerStarted","Data":"392a27b650349d1147ae600c6a2ce79bbd6debcf5119595e555dd1f14b2bd26c"}
Jul 28 20:46:02.231040 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.230984    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:46:02.250390 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.250339    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v7znx" podStartSLOduration=66.250322075 podStartE2EDuration="1m6.250322075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:02.249418611 +0000 UTC m=+67.083662210" watchObservedRunningTime="2026-07-28 20:46:02.250322075 +0000 UTC m=+67.084565675"
Jul 28 20:46:02.317692 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.317603    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:02.395950 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.395915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:02.822050 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.822013    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:02.951863 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:02.951829    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:03.050606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.050559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:46:03.050833 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.050622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:46:03.050833 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.050659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:46:03.050833 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.050709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:46:03.051111 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.051071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:03.051258 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.051132    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:46:03.051258 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.051179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:03.052653 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.052103    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-service-ca-bundle\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:03.052653 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:46:03.052208    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:46:03.052653 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:46:03.052267    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert podName:f45b548f-b66e-472f-ab6a-8b9a27b4a6e6 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:35.052248959 +0000 UTC m=+99.886492542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-4mvzm" (UID: "f45b548f-b66e-472f-ab6a-8b9a27b4a6e6") : secret "networking-console-plugin-cert" not found
Jul 28 20:46:03.054247 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.054156    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"image-registry-866c8d54bc-s8zbn\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") " pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:46:03.054247 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.054206    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/066c3763-70d4-4496-9993-09cd26a2e18c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-z5nwx\" (UID: \"066c3763-70d4-4496-9993-09cd26a2e18c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:46:03.054247 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.054211    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07249afe-c3d4-46e3-bc8d-7fb92081b7d1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zh9xm\" (UID: \"07249afe-c3d4-46e3-bc8d-7fb92081b7d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:46:03.054482 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.054315    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe6d8528-3f55-46bd-b0ff-ad963b8a46f1-metrics-certs\") pod \"router-default-ff76cddc9-wcv8g\" (UID: \"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1\") " pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:03.055262 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.055243    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c0027b-a4e7-4939-8aaf-deda3a9ee484-metrics-tls\") pod \"dns-default-g4jxs\" (UID: \"23c0027b-a4e7-4939-8aaf-deda3a9ee484\") " pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:46:03.174558 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.174525    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bzp98\""
Jul 28 20:46:03.182342 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.182308    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"
Jul 28 20:46:03.211547 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.211514    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w2hgh\""
Jul 28 20:46:03.219398 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.219370    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"
Jul 28 20:46:03.228737 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.228714    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kskpf\""
Jul 28 20:46:03.236736 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.236711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:46:03.257853 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.257567    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-58ks8\""
Jul 28 20:46:03.264016 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.263947    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:03.267073 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.266855    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ph6jd\""
Jul 28 20:46:03.277765 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.277362    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:46:03.369265 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.369186    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm"]
Jul 28 20:46:03.461644 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.461614    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx"]
Jul 28 20:46:03.489996 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.489968    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866c8d54bc-s8zbn"]
Jul 28 20:46:03.499919 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:03.499886    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa08ae3_0777_47b2_8a4a_1627f28c6bd8.slice/crio-3f807000a778bf7be21fa1ba34fc3e47e3a5409c9a624fbdfdc41351d1b5b673 WatchSource:0}: Error finding container 3f807000a778bf7be21fa1ba34fc3e47e3a5409c9a624fbdfdc41351d1b5b673: Status 404 returned error can't find the container with id 3f807000a778bf7be21fa1ba34fc3e47e3a5409c9a624fbdfdc41351d1b5b673
Jul 28 20:46:03.511026 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.510997    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ff76cddc9-wcv8g"]
Jul 28 20:46:03.515703 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:03.515668    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6d8528_3f55_46bd_b0ff_ad963b8a46f1.slice/crio-964fbea52b555c59d3127595ad5fa8c6bc7623bddea0efc8145a473ddfde5a0a WatchSource:0}: Error finding container 964fbea52b555c59d3127595ad5fa8c6bc7623bddea0efc8145a473ddfde5a0a: Status 404 returned error can't find the container with id 964fbea52b555c59d3127595ad5fa8c6bc7623bddea0efc8145a473ddfde5a0a
Jul 28 20:46:03.553429 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.553387    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4jxs"]
Jul 28 20:46:03.564042 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:03.564011    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c0027b_a4e7_4939_8aaf_deda3a9ee484.slice/crio-78f9fe0d550bf4946127c6ee9811fcaaf00e730f1b00e0900ba54ad168b4859e WatchSource:0}: Error finding container 78f9fe0d550bf4946127c6ee9811fcaaf00e730f1b00e0900ba54ad168b4859e: Status 404 returned error can't find the container with id 78f9fe0d550bf4946127c6ee9811fcaaf00e730f1b00e0900ba54ad168b4859e
Jul 28 20:46:03.614268 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.614234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:03.792764 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:03.792671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:04.197268 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.197227    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:04.243949 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.243868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4jxs" event={"ID":"23c0027b-a4e7-4939-8aaf-deda3a9ee484","Type":"ContainerStarted","Data":"78f9fe0d550bf4946127c6ee9811fcaaf00e730f1b00e0900ba54ad168b4859e"}
Jul 28 20:46:04.246829 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.246508    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn" event={"ID":"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8","Type":"ContainerStarted","Data":"52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49"}
Jul 28 20:46:04.246829 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.246558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn" event={"ID":"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8","Type":"ContainerStarted","Data":"3f807000a778bf7be21fa1ba34fc3e47e3a5409c9a624fbdfdc41351d1b5b673"}
Jul 28 20:46:04.247061 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.246872    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:46:04.248499 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.248441    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx" event={"ID":"066c3763-70d4-4496-9993-09cd26a2e18c","Type":"ContainerStarted","Data":"2666c5d2b61eba08f8ee66eac07cd799aafed1bdb2efbacd6087c00b0d984234"}
Jul 28 20:46:04.250563 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.250475    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ff76cddc9-wcv8g" event={"ID":"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1","Type":"ContainerStarted","Data":"9c17f0571f3aba39fc7cde6e210c35b59599642de7a2788714d547fd68c1594c"}
Jul 28 20:46:04.250563 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.250515    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ff76cddc9-wcv8g" event={"ID":"fe6d8528-3f55-46bd-b0ff-ad963b8a46f1","Type":"ContainerStarted","Data":"964fbea52b555c59d3127595ad5fa8c6bc7623bddea0efc8145a473ddfde5a0a"}
Jul 28 20:46:04.252600 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.252571    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm" event={"ID":"07249afe-c3d4-46e3-bc8d-7fb92081b7d1","Type":"ContainerStarted","Data":"ed634dfb652a096d017435e832ea829e8151385150db1ebf5ba93bc1c4348089"}
Jul 28 20:46:04.265537 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.265445    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:04.268445 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.268416    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:04.273748 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.273685    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn" podStartSLOduration=60.273661969 podStartE2EDuration="1m0.273661969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:04.27090952 +0000 UTC m=+69.105153101" watchObservedRunningTime="2026-07-28 20:46:04.273661969 +0000 UTC m=+69.107905552"
Jul 28 20:46:04.298736 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.298041    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-ff76cddc9-wcv8g" podStartSLOduration=60.298021579 podStartE2EDuration="1m0.298021579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:04.296886499 +0000 UTC m=+69.131130085" watchObservedRunningTime="2026-07-28 20:46:04.298021579 +0000 UTC m=+69.132265168"
Jul 28 20:46:04.391597 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.391549    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:04.570360 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.570264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:46:04.570360 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.570337    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:46:04.570556 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:46:04.570475    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:46:04.570556 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:46:04.570525    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls podName:47466a8c-0bbb-483e-bcf4-7bed1250f202 nodeName:}" failed. No retries permitted until 2026-07-28 20:46:20.570512043 +0000 UTC m=+85.404755607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2j6wh" (UID: "47466a8c-0bbb-483e-bcf4-7bed1250f202") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:46:04.571417 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.571352    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47466a8c-0bbb-483e-bcf4-7bed1250f202-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:46:04.588887 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.588850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:04.713482 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:04.711963    2572 scope.go:117] "RemoveContainer" containerID="90bf5140f0f738d417408b7d72fa55b4a06f2f7dab15a6003b9b694444ecf08f"
Jul 28 20:46:05.211227 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.211184    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:05.258595 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.258571    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:46:05.258760 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.258706    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" event={"ID":"d77639c8-4cde-4fbb-bfd9-6135d793d25d","Type":"ContainerStarted","Data":"7493e0201d74912edd235c8ae162ec43f14e3255781f92da330c3f6264faf7f6"}
Jul 28 20:46:05.259385 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.259354    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:05.259935 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.259873    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:46:05.260458 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.260438    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-ff76cddc9-wcv8g"
Jul 28 20:46:05.283648 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.283568    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" podStartSLOduration=47.4265746 podStartE2EDuration="1m1.283550377s" totalImagesPullingTime="13.856975777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:05.282364417 +0000 UTC m=+70.116608006" watchObservedRunningTime="2026-07-28 20:46:05.283550377 +0000 UTC m=+70.117793962"
Jul 28 20:46:05.583502 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.583414    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:05.991284 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:05.991244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:06.181478 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.181445    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:06.259678 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.259567    2572 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-tbmzs container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 20:46:06.259678 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.259649    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs" podUID="d77639c8-4cde-4fbb-bfd9-6135d793d25d" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 28 20:46:06.430758 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.430705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:06.491652 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.491624    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-tbmzs"
Jul 28 20:46:06.588134 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.588055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:06.698318 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.698278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:06.801710 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.801668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:06.882154 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:06.882119    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:07.022982 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:07.022949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:07.353308 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:07.353238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:07.454450 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:07.454412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:07.560557 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:07.560525    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:07.667747 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:07.667710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:07.819959 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:07.819925    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:07.912705 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:07.912669    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:08.274772 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.274660    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4jxs" event={"ID":"23c0027b-a4e7-4939-8aaf-deda3a9ee484","Type":"ContainerStarted","Data":"baf413182c706d3c7fd665caca5f7064ad338322abbfa8e4c792ac01330a19c2"}
Jul 28 20:46:08.274772 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.274734    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4jxs" event={"ID":"23c0027b-a4e7-4939-8aaf-deda3a9ee484","Type":"ContainerStarted","Data":"941c8e04f44ed36413dcf932e32e8dd035921eb920df07b534d6b837f2ba6d06"}
Jul 28 20:46:08.275016 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.274773    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:46:08.276401 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.276366    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5chvb" event={"ID":"24d41e59-b89c-4178-91b2-af1dc84e86ed","Type":"ContainerStarted","Data":"b392c34a125903bf8f2abb531050cb614c43307b1a3231aa3c4b994eb13c6af9"}
Jul 28 20:46:08.277963 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.277941    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx" event={"ID":"066c3763-70d4-4496-9993-09cd26a2e18c","Type":"ContainerStarted","Data":"897e6dad286378356fc9200b6c74859b3ab4b6c487f5df60802186eb6337ceef"}
Jul 28 20:46:08.279733 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.279710    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm" event={"ID":"07249afe-c3d4-46e3-bc8d-7fb92081b7d1","Type":"ContainerStarted","Data":"ed49c2da9e8bfc53856165968d046efb85535daf8cc11c11d79c1ef79843d38b"}
Jul 28 20:46:08.279852 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.279755    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm" event={"ID":"07249afe-c3d4-46e3-bc8d-7fb92081b7d1","Type":"ContainerStarted","Data":"02ec6e2a37994af6128f85fc596ce77972bdd911106add6e07a312a9705e5226"}
Jul 28 20:46:08.286294 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.286261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:08.299624 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.299575    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g4jxs" podStartSLOduration=32.995239684 podStartE2EDuration="37.29955716s" totalImagesPullingTime="4.304317476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:08.297688571 +0000 UTC m=+73.131932157" watchObservedRunningTime="2026-07-28 20:46:08.29955716 +0000 UTC m=+73.133800745"
Jul 28 20:46:08.320464 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.320405    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zh9xm" podStartSLOduration=59.93771335 podStartE2EDuration="1m4.320389195s" totalImagesPullingTime="4.382675845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:08.318883954 +0000 UTC m=+73.153127539" watchObservedRunningTime="2026-07-28 20:46:08.320389195 +0000 UTC m=+73.154632781"
Jul 28 20:46:08.338933 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.338866    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5chvb" podStartSLOduration=66.092011858 podStartE2EDuration="1m12.338849266s" totalImagesPullingTime="6.246837408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:08.337016227 +0000 UTC m=+73.171259814" watchObservedRunningTime="2026-07-28 20:46:08.338849266 +0000 UTC m=+73.173092851"
Jul 28 20:46:08.361265 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.361202    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-z5nwx" podStartSLOduration=59.964184854 podStartE2EDuration="1m4.36117809s" totalImagesPullingTime="4.396993236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:08.360056873 +0000 UTC m=+73.194300453" watchObservedRunningTime="2026-07-28 20:46:08.36117809 +0000 UTC m=+73.195421678"
Jul 28 20:46:08.363906 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.363880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:08.439396 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.439369    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:08.538905 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.538813    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:08.626816 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.626758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:08.771123 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.771088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:08.872881 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:08.872844    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:09.616442 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:09.613170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:09.682461 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:09.682427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:12.914868 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:12.914840    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-866c8d54bc-s8zbn"]
Jul 28 20:46:12.965200 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:12.965173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:13.067187 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:13.067153    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:13.249973 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:13.249895    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:13.858455 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:13.858422    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:14.016189 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:14.016157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:14.520802 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:14.520752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:14.594123 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:14.594088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:17.986075 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:17.985963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:18.285687 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:18.285613    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g4jxs"
Jul 28 20:46:18.965376 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:18.965340    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:19.040202 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:19.040169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:20.610543 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:20.610510    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:20.619675 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:20.619647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:46:20.622138 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:20.622108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47466a8c-0bbb-483e-bcf4-7bed1250f202-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2j6wh\" (UID: \"47466a8c-0bbb-483e-bcf4-7bed1250f202\") " pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:46:20.704823 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:20.704762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:20.858998 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:20.858969    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nwhvj\""
Jul 28 20:46:20.866337 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:20.866263    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2j6wh"
Jul 28 20:46:21.019920 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:21.019894    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2j6wh"]
Jul 28 20:46:21.022445 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:21.022414    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47466a8c_0bbb_483e_bcf4_7bed1250f202.slice/crio-b7fe1e316e4046d378c15ca1f386671877775ac90cd75a62eba8bfc7f03f5fcf WatchSource:0}: Error finding container b7fe1e316e4046d378c15ca1f386671877775ac90cd75a62eba8bfc7f03f5fcf: Status 404 returned error can't find the container with id b7fe1e316e4046d378c15ca1f386671877775ac90cd75a62eba8bfc7f03f5fcf
Jul 28 20:46:21.325223 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:21.325188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2j6wh" event={"ID":"47466a8c-0bbb-483e-bcf4-7bed1250f202","Type":"ContainerStarted","Data":"b7fe1e316e4046d378c15ca1f386671877775ac90cd75a62eba8bfc7f03f5fcf"}
Jul 28 20:46:21.503065 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:21.503033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:21.579107 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:21.579021    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:21.794725 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:21.794692    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:22.921586 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:22.921538    2572 patch_prober.go:28] interesting pod/image-registry-866c8d54bc-s8zbn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 20:46:22.922031 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:22.921610    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn" podUID="cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:46:23.796500 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:23.796461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:23.872501 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:23.872449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:25.938217 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:25.938178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:26.038618 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:26.038584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:26.351301 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:26.351214    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2j6wh" event={"ID":"47466a8c-0bbb-483e-bcf4-7bed1250f202","Type":"ContainerStarted","Data":"1b27c969e673690672e18a02a22b4d0d19016ca649b74c5635d8e83f62d585f2"}
Jul 28 20:46:26.362997 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:26.362958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:26.812976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:26.812935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:26.884118 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:26.884072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:27.654083 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.654043    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:27.903160 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.903128    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:27.960805 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.960708    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rwr56"]
Jul 28 20:46:27.971815 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.971757    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:27.976035 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.976006    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 20:46:27.976206 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.976168    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 20:46:27.976280 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.976241    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tsvt2\""
Jul 28 20:46:27.976412 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.976390    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 20:46:27.977472 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:27.977453    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 20:46:28.008593 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.008556    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:28.083813 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.083757    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:28.091336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091302    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-wtmp\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091522 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091522 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091382    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-tls\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091522 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-metrics-client-ca\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091522 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-root\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091522 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091495    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091759 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-sys\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091759 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091579    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7stj\" (UniqueName: \"kubernetes.io/projected/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-kube-api-access-b7stj\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.091759 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.091610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-textfile\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.192925 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.192878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-root\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193104 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.192939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193104 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-sys\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193104 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193004    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-root\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193104 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7stj\" (UniqueName: \"kubernetes.io/projected/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-kube-api-access-b7stj\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193104 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193072    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-sys\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193104 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193084    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-textfile\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193411 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-wtmp\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193411 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193411 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-tls\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193411 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193214    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-metrics-client-ca\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193601 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193426    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-textfile\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193649 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193620    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193730 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193665    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-wtmp\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.193870 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.193845    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-metrics-client-ca\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.196178 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.196154    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-tls\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.196178 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.196175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.202447 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.202420    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7stj\" (UniqueName: \"kubernetes.io/projected/56625417-4fa8-4fa3-8ab0-b3fcc9012cdf-kube-api-access-b7stj\") pod \"node-exporter-rwr56\" (UID: \"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf\") " pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.207723 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.207677    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:28.284853 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.284756    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwr56"
Jul 28 20:46:28.308597 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.308560    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:28.448817 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.448757    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:28.543197 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.543095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:28.695011 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.694973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:28.907552 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:28.907523    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:29.010465 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:29.010433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:29.223592 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:29.223506    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:29.685919 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:29.685883    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56625417_4fa8_4fa3_8ab0_b3fcc9012cdf.slice/crio-05d1f8547e104508b2b3d2d832e491b1b11b0f0d63de09476d308dac012fbffe WatchSource:0}: Error finding container 05d1f8547e104508b2b3d2d832e491b1b11b0f0d63de09476d308dac012fbffe: Status 404 returned error can't find the container with id 05d1f8547e104508b2b3d2d832e491b1b11b0f0d63de09476d308dac012fbffe
Jul 28 20:46:30.369974 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:30.369934    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwr56" event={"ID":"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf","Type":"ContainerStarted","Data":"05d1f8547e104508b2b3d2d832e491b1b11b0f0d63de09476d308dac012fbffe"}
Jul 28 20:46:30.372297 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:30.372271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2j6wh" event={"ID":"47466a8c-0bbb-483e-bcf4-7bed1250f202","Type":"ContainerStarted","Data":"8b68b94b4fa75e08c3d75721880ac3b9865489e077ff878dcffb6b391b568098"}
Jul 28 20:46:30.577921 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:30.577881    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:30.646936 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:30.646906    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:30.827942 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:30.827914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:30.929850 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:30.929707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:31.027121 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:31.027089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:31.312329 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:31.312211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:31.378388 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:31.378357    2572 generic.go:356] "Generic (PLEG): container finished" podID="56625417-4fa8-4fa3-8ab0-b3fcc9012cdf" containerID="95a1890076d1a384c53a8d76acb3d59fc875f81bbce5765e55086230801e1737" exitCode=0
Jul 28 20:46:31.378900 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:31.378464    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwr56" event={"ID":"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf","Type":"ContainerDied","Data":"95a1890076d1a384c53a8d76acb3d59fc875f81bbce5765e55086230801e1737"}
Jul 28 20:46:31.407500 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:31.407469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:31.512416 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:31.512363    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:32.385686 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:32.385628    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwr56" event={"ID":"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf","Type":"ContainerStarted","Data":"ed8e669f6a48bc3d84ed90dacb2e8985d34814dc8b1f4c038dfed2434f0a83e3"}
Jul 28 20:46:32.386175 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:32.385724    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwr56" event={"ID":"56625417-4fa8-4fa3-8ab0-b3fcc9012cdf","Type":"ContainerStarted","Data":"c0700a8422dc51b4bfaa5a286311381dc51f40123e02ad079ec6ccab308efec0"}
Jul 28 20:46:32.411827 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:32.411744    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rwr56" podStartSLOduration=4.226809569 podStartE2EDuration="5.411728178s" totalImagesPullingTime="1.098055229s" totalInitContainerRuntime="86.86338ms" isStatefulPod=true podCreationTimestamp="2026-07-28 20:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:32.409589639 +0000 UTC m=+97.243833226" watchObservedRunningTime="2026-07-28 20:46:32.411728178 +0000 UTC m=+97.245971742"
Jul 28 20:46:32.708606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:32.708498    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:32.788667 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:32.788631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:32.920054 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:32.920024    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:46:33.237802 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:33.237742    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v7znx"
Jul 28 20:46:33.274548 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:33.274514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:34.370063 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:34.370030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:34.396609 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:34.396573    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2j6wh" event={"ID":"47466a8c-0bbb-483e-bcf4-7bed1250f202","Type":"ContainerStarted","Data":"ce3b56d0d89b88b4a3fc7d19a93552c2c9c454b3326a021d505021532710c164"}
Jul 28 20:46:34.447857 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:34.447799    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2j6wh" podStartSLOduration=33.989242241 podStartE2EDuration="46.44775573s" totalImagesPullingTime="12.458513489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:45:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:34.44165032 +0000 UTC m=+99.275893903" watchObservedRunningTime="2026-07-28 20:46:34.44775573 +0000 UTC m=+99.281999315"
Jul 28 20:46:34.823841 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:34.823800    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:34.914948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:34.914910    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:35.032652 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.032608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:35.055869 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.055831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:46:35.058350 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.058318    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45b548f-b66e-472f-ab6a-8b9a27b4a6e6-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-4mvzm\" (UID: \"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:46:35.073087 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.073063    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rn8mk\""
Jul 28 20:46:35.081030 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.080970    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"
Jul 28 20:46:35.156640 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.156611    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:35.236501 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.236479    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm"]
Jul 28 20:46:35.239267 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:46:35.239233    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45b548f_b66e_472f_ab6a_8b9a27b4a6e6.slice/crio-ea4ec992ff1e7081e99fcee478dd327d58c915f28c39dc89e481e000e2e5e32a WatchSource:0}: Error finding container ea4ec992ff1e7081e99fcee478dd327d58c915f28c39dc89e481e000e2e5e32a: Status 404 returned error can't find the container with id ea4ec992ff1e7081e99fcee478dd327d58c915f28c39dc89e481e000e2e5e32a
Jul 28 20:46:35.277764 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.277727    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:35.363262 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.363164    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:35.402160 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:35.402126    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm" event={"ID":"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6","Type":"ContainerStarted","Data":"ea4ec992ff1e7081e99fcee478dd327d58c915f28c39dc89e481e000e2e5e32a"}
Jul 28 20:46:37.411092 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:37.411053    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm" event={"ID":"f45b548f-b66e-472f-ab6a-8b9a27b4a6e6","Type":"ContainerStarted","Data":"440b7029ec0887bae426fc747b7bf96d3c5b786f8e01d72ae6f37c2e9278986e"}
Jul 28 20:46:37.431707 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:37.431651    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-4mvzm" podStartSLOduration=91.238852034 podStartE2EDuration="1m32.431633144s" totalImagesPullingTime="1.19278111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:46:37.429923495 +0000 UTC m=+102.264167082" watchObservedRunningTime="2026-07-28 20:46:37.431633144 +0000 UTC m=+102.265876767"
Jul 28 20:46:37.539947 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:37.539904    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:37.639603 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:37.639566    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:37.740928 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:37.740838    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:37.882319 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:37.882288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:37.936247 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:37.936212    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn" podUID="cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" containerName="registry" containerID="cri-o://52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49" gracePeriod=30
Jul 28 20:46:38.183918 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.183890    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:46:38.284400 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284368    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.284574 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284430    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-image-registry-private-configuration\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.284574 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284481    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-ca-trust-extracted\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.284574 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284510    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-bound-sa-token\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.284574 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284550    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-trusted-ca\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.284855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284583    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t8gj\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-kube-api-access-9t8gj\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.284855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284640    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-installation-pull-secrets\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.284855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.284693    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-certificates\") pod \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\" (UID: \"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8\") "
Jul 28 20:46:38.285271 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.285207    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:46:38.285594 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.285461    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:46:38.287585 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.287523    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:46:38.287693 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.287674    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:46:38.287750 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.287684    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:46:38.287827 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.287757    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-kube-api-access-9t8gj" (OuterVolumeSpecName: "kube-api-access-9t8gj") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "kube-api-access-9t8gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:46:38.287885 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.287835    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:46:38.293869 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.293841    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" (UID: "cfa08ae3-0777-47b2-8a4a-1627f28c6bd8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:46:38.386358 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386316    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-installation-pull-secrets\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.386358 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386348    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-certificates\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.386358 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386360    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-registry-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.386358 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386370    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-image-registry-private-configuration\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.386689 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386379    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-ca-trust-extracted\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.386689 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386387    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-bound-sa-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.386689 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386395    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-trusted-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.386689 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.386402    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t8gj\" (UniqueName: \"kubernetes.io/projected/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8-kube-api-access-9t8gj\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 20:46:38.417264 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.417227    2572 generic.go:356] "Generic (PLEG): container finished" podID="cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" containerID="52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49" exitCode=0
Jul 28 20:46:38.417774 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.417270    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn"
Jul 28 20:46:38.417774 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.417323    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn" event={"ID":"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8","Type":"ContainerDied","Data":"52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49"}
Jul 28 20:46:38.417774 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.417451    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866c8d54bc-s8zbn" event={"ID":"cfa08ae3-0777-47b2-8a4a-1627f28c6bd8","Type":"ContainerDied","Data":"3f807000a778bf7be21fa1ba34fc3e47e3a5409c9a624fbdfdc41351d1b5b673"}
Jul 28 20:46:38.417774 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.417480    2572 scope.go:117] "RemoveContainer" containerID="52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49"
Jul 28 20:46:38.427179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.427158    2572 scope.go:117] "RemoveContainer" containerID="52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49"
Jul 28 20:46:38.427552 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:46:38.427530    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49\": container with ID starting with 52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49 not found: ID does not exist" containerID="52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49"
Jul 28 20:46:38.427603 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.427563    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49"} err="failed to get container status \"52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49\": rpc error: code = NotFound desc = could not find container \"52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49\": container with ID starting with 52183ce5ba556d83c29b3c373e2990a50281e988ba5df1cfc1b92bb303e07f49 not found: ID does not exist"
Jul 28 20:46:38.440124 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.440083    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-866c8d54bc-s8zbn"]
Jul 28 20:46:38.444497 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:38.444464    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-866c8d54bc-s8zbn"]
Jul 28 20:46:39.717057 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:39.717028    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" path="/var/lib/kubelet/pods/cfa08ae3-0777-47b2-8a4a-1627f28c6bd8/volumes"
Jul 28 20:46:40.464217 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:40.464189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:40.534222 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:40.534195    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:43.961145 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:43.961118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:44.061042 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:44.061011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:45.809230 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:45.809192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:45.913324 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:45.913292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:46.006337 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:46.006302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:52.719443 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:52.719401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:52.793838 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:52.793774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:46:53.473897 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:53.473864    2572 generic.go:356] "Generic (PLEG): container finished" podID="a7b98624-56de-4710-b2cc-e4b4889f391d" containerID="97cca8412770ecef7c8f8b5cb246b8d1a0c6e266999a76d6be8b44a0bd7dcb0e" exitCode=0
Jul 28 20:46:53.474086 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:53.473909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t" event={"ID":"a7b98624-56de-4710-b2cc-e4b4889f391d","Type":"ContainerDied","Data":"97cca8412770ecef7c8f8b5cb246b8d1a0c6e266999a76d6be8b44a0bd7dcb0e"}
Jul 28 20:46:53.474228 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:53.474215    2572 scope.go:117] "RemoveContainer" containerID="97cca8412770ecef7c8f8b5cb246b8d1a0c6e266999a76d6be8b44a0bd7dcb0e"
Jul 28 20:46:54.479475 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:46:54.479446    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rrm2t" event={"ID":"a7b98624-56de-4710-b2cc-e4b4889f391d","Type":"ContainerStarted","Data":"928def8fa4f66c2beea0cc5f0c041d65fa97f9739b3592a5d117fe075fb50f8d"}
Jul 28 20:47:05.514728 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:05.514665    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:47:05.517309 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:05.517282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ac58d4c-790e-4d2e-bd81-376067877ce0-metrics-certs\") pod \"network-metrics-daemon-b6hg6\" (UID: \"2ac58d4c-790e-4d2e-bd81-376067877ce0\") " pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:47:05.694808 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:05.694760    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2qcwd\""
Jul 28 20:47:05.701935 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:05.701908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b6hg6"
Jul 28 20:47:05.887113 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:05.887075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b6hg6"]
Jul 28 20:47:05.890366 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:47:05.890334    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac58d4c_790e_4d2e_bd81_376067877ce0.slice/crio-d93c3bc38237c92fde08a05639cd1bc032ba1071638d18bf80dd7d350965505c WatchSource:0}: Error finding container d93c3bc38237c92fde08a05639cd1bc032ba1071638d18bf80dd7d350965505c: Status 404 returned error can't find the container with id d93c3bc38237c92fde08a05639cd1bc032ba1071638d18bf80dd7d350965505c
Jul 28 20:47:06.524979 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:06.524942    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b6hg6" event={"ID":"2ac58d4c-790e-4d2e-bd81-376067877ce0","Type":"ContainerStarted","Data":"d93c3bc38237c92fde08a05639cd1bc032ba1071638d18bf80dd7d350965505c"}
Jul 28 20:47:06.939086 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:06.939045    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:07.530192 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:07.530163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b6hg6" event={"ID":"2ac58d4c-790e-4d2e-bd81-376067877ce0","Type":"ContainerStarted","Data":"5fa702960448585f52f46bd6d9674fdc0f0900520f571f5474b2834aaf6e0a82"}
Jul 28 20:47:08.536131 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:08.536030    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b6hg6" event={"ID":"2ac58d4c-790e-4d2e-bd81-376067877ce0","Type":"ContainerStarted","Data":"631bbb4b95362a066508b065a80bdf767063044de65a3c4ff55a6361e45ed115"}
Jul 28 20:47:08.537600 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:08.537574    2572 generic.go:356] "Generic (PLEG): container finished" podID="9bcb3f8a-3b1b-434b-bb58-791882b8b654" containerID="d6a2e25a38821d7fc46e1e52146caa62a012ba56b70145eb669bb8e9bb08fab8" exitCode=0
Jul 28 20:47:08.537728 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:08.537616    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p" event={"ID":"9bcb3f8a-3b1b-434b-bb58-791882b8b654","Type":"ContainerDied","Data":"d6a2e25a38821d7fc46e1e52146caa62a012ba56b70145eb669bb8e9bb08fab8"}
Jul 28 20:47:08.537915 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:08.537900    2572 scope.go:117] "RemoveContainer" containerID="d6a2e25a38821d7fc46e1e52146caa62a012ba56b70145eb669bb8e9bb08fab8"
Jul 28 20:47:08.554003 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:08.553810    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b6hg6" podStartSLOduration=131.056875629 podStartE2EDuration="2m12.553768017s" totalImagesPullingTime="1.496892388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:08.553402805 +0000 UTC m=+133.387646422" watchObservedRunningTime="2026-07-28 20:47:08.553768017 +0000 UTC m=+133.388011604"
Jul 28 20:47:08.689008 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:08.688966    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:08.761058 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:08.761021    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:09.548466 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:09.548433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-t592p" event={"ID":"9bcb3f8a-3b1b-434b-bb58-791882b8b654","Type":"ContainerStarted","Data":"690ac79eca5eaa702f762d8432df8a864a0d5750ff8113a7188c1aed41473eb1"}
Jul 28 20:47:11.530412 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:11.530369    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" podUID="abb747b6-437a-4157-aadb-855489061b3e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 20:47:16.186722 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:16.186686    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:16.299976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:16.299939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:16.369070 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:16.369038    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:18.584056 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:18.583967    2572 generic.go:356] "Generic (PLEG): container finished" podID="f872cb95-d3c5-4f9c-a22f-73dc88da028d" containerID="257a57908e9d33dea522666705de467caf73f8954a4c077b5e079d5506653f00" exitCode=0
Jul 28 20:47:18.584056 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:18.584006    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dmh6c" event={"ID":"f872cb95-d3c5-4f9c-a22f-73dc88da028d","Type":"ContainerDied","Data":"257a57908e9d33dea522666705de467caf73f8954a4c077b5e079d5506653f00"}
Jul 28 20:47:18.584473 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:18.584363    2572 scope.go:117] "RemoveContainer" containerID="257a57908e9d33dea522666705de467caf73f8954a4c077b5e079d5506653f00"
Jul 28 20:47:19.589710 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:19.589676    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-dmh6c" event={"ID":"f872cb95-d3c5-4f9c-a22f-73dc88da028d","Type":"ContainerStarted","Data":"9509286e101c7395c62f3661f5f408311c9ce38ce2e042069a61f580d76c8a51"}
Jul 28 20:47:21.530550 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:21.530507    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" podUID="abb747b6-437a-4157-aadb-855489061b3e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 20:47:31.529947 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:31.529908    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" podUID="abb747b6-437a-4157-aadb-855489061b3e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 20:47:31.530443 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:31.530013    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc"
Jul 28 20:47:31.530659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:31.530631    2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8b268ff75bf98d42e20c9491b03609deed0ee82c7990ccc07849c21862263cac"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 28 20:47:31.530773 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:31.530686    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" podUID="abb747b6-437a-4157-aadb-855489061b3e" containerName="service-proxy" containerID="cri-o://8b268ff75bf98d42e20c9491b03609deed0ee82c7990ccc07849c21862263cac" gracePeriod=30
Jul 28 20:47:32.645233 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:32.645197    2572 generic.go:356] "Generic (PLEG): container finished" podID="abb747b6-437a-4157-aadb-855489061b3e" containerID="8b268ff75bf98d42e20c9491b03609deed0ee82c7990ccc07849c21862263cac" exitCode=2
Jul 28 20:47:32.645691 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:32.645233    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" event={"ID":"abb747b6-437a-4157-aadb-855489061b3e","Type":"ContainerDied","Data":"8b268ff75bf98d42e20c9491b03609deed0ee82c7990ccc07849c21862263cac"}
Jul 28 20:47:32.645691 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:32.645292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7666f4df-xnqvc" event={"ID":"abb747b6-437a-4157-aadb-855489061b3e","Type":"ContainerStarted","Data":"fc89f635c4ec1765ca0d7e3d17ebb3b07161b137ee7aeeaa2f2131cb7f9bdd1f"}
Jul 28 20:47:47.336314 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:47.336231    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:47.710394 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:47.710364    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:56.753336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:56.753302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:47:56.829178 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:47:56.829144    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:48:08.088395 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:48:08.088361    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:48:08.193714 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:48:08.193682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:48:08.267362 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:48:08.267318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:48:49.260988 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:48:49.260949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:48:49.406961 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:48:49.406922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:02.684396 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:02.684364    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:02.768439 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:02.768410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:06.816963 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:06.816931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:06.917732 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:06.917698    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:07.018968 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:07.018935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:07.548383 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:07.548350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:07.649027 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:07.648999    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:14.689069 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:14.689033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:14.768070 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:14.768038    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:17.399336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:17.399245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:17.498017 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:17.497989    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:17.588304 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:17.588266    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:22.757756 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:22.757725    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:22.855365 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:22.855331    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:49:55.598033 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:55.598004    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:49:55.608568 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:55.608541    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 20:49:55.615436 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:55.615413    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:49:55.929387 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:49:55.929357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:05.905338 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:05.905302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:05.964518 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:05.964485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:14.659713 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:14.659675    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:14.727855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:14.727770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:18.463847 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:18.463814    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:18.560433 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:18.560398    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:22.813176 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:22.813137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:45.578758 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:45.578721    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:46.428092 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:46.427997    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:49.187244 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:49.187215    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:49.289412 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:49.289380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:53.554980 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:53.554945    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:53.650887 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:53.650853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:53.906122 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:53.906087    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:54.042694 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:54.042660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:54.423253 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:54.423220    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:54.524147 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:54.524107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:55.766607 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:55.766577    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:55.829839 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:55.829806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:50:56.189739 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:50:56.189702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:03.565363 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:03.565321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:06.870970 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:06.870933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:07.052047 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:07.052016    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:12.735918 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:12.735880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:12.835302 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:12.835265    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:14.465425 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:14.465388    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:14.533711 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:14.533676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:14.855241 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:14.855123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:30.827440 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:30.827407    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:30.930558 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:30.930524    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:31.179376 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:31.179340    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:31.318240 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:31.318209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:31.475992 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:31.475899    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:31.893814 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:31.893767    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.028861 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.028831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.051269 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.051242    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"]
Jul 28 20:51:32.051523 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.051512    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" containerName="registry"
Jul 28 20:51:32.051566 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.051525    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" containerName="registry"
Jul 28 20:51:32.051600 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.051591    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfa08ae3-0777-47b2-8a4a-1627f28c6bd8" containerName="registry"
Jul 28 20:51:32.054507 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.054490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.058447 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.058420    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 20:51:32.058621 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.058421    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 20:51:32.058621 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.058526    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gm89g\""
Jul 28 20:51:32.058768 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.058709    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 20:51:32.059484 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.059467    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 20:51:32.074188 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.074157    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"]
Jul 28 20:51:32.137332 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.137298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-tmp\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.137537 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.137360    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-manifests\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.137537 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.137436    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.137537 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.137469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.137537 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.137505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnw5p\" (UniqueName: \"kubernetes.io/projected/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-kube-api-access-cnw5p\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.213851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.213752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.237945 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.237913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.238049 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.237954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.238049 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.238002    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnw5p\" (UniqueName: \"kubernetes.io/projected/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-kube-api-access-cnw5p\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.238049 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.238035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-tmp\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.238183 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.238101    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-manifests\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.238492 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.238467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-manifests\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.240598 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.240578    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-tmp\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.240725 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.240629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.240725 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.240721    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.250870 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.250842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnw5p\" (UniqueName: \"kubernetes.io/projected/2502f14a-6d0c-466c-ab6d-f29b2c04a7a7-kube-api-access-cnw5p\") pod \"opendatahub-operator-controller-manager-5966989555-l26n6\" (UID: \"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.340017 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.339970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.364946 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.364908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:32.429619 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.429589    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.505835 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.505727    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"]
Jul 28 20:51:32.509257 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:51:32.509231    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2502f14a_6d0c_466c_ab6d_f29b2c04a7a7.slice/crio-995f654c41ef0420d305c9ab9f702507e528b3e0fab1e4eb4934bf5765a96d0d WatchSource:0}: Error finding container 995f654c41ef0420d305c9ab9f702507e528b3e0fab1e4eb4934bf5765a96d0d: Status 404 returned error can't find the container with id 995f654c41ef0420d305c9ab9f702507e528b3e0fab1e4eb4934bf5765a96d0d
Jul 28 20:51:32.511036 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.511020    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:51:32.514457 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.514434    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.540659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.540613    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6" event={"ID":"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7","Type":"ContainerStarted","Data":"995f654c41ef0420d305c9ab9f702507e528b3e0fab1e4eb4934bf5765a96d0d"}
Jul 28 20:51:32.590637 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.590606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.694200 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.694166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:32.796175 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:32.796079    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:36.560292 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:36.560251    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6" event={"ID":"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7","Type":"ContainerStarted","Data":"04436e7b3546f45146f6b87daa721d137551a21ea5108113594ea5ba4086d1f9"}
Jul 28 20:51:36.938530 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:36.938492    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:37.565905 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:37.565871    2572 generic.go:356] "Generic (PLEG): container finished" podID="2502f14a-6d0c-466c-ab6d-f29b2c04a7a7" containerID="04436e7b3546f45146f6b87daa721d137551a21ea5108113594ea5ba4086d1f9" exitCode=0
Jul 28 20:51:37.566286 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:37.565962    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6" event={"ID":"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7","Type":"ContainerDied","Data":"04436e7b3546f45146f6b87daa721d137551a21ea5108113594ea5ba4086d1f9"}
Jul 28 20:51:38.572494 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:38.572457    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6" event={"ID":"2502f14a-6d0c-466c-ab6d-f29b2c04a7a7","Type":"ContainerStarted","Data":"6cc6d12303b769fcbe41507ddf65e934b3fe246728e97e0b8e48d162e0864c6e"}
Jul 28 20:51:38.572937 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:38.572601    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:38.607030 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:38.606968    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6" podStartSLOduration=2.236265104 podStartE2EDuration="6.606947926s" totalImagesPullingTime="3.308899779s" totalInitContainerRuntime="1.061783043s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:51:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:51:38.605566707 +0000 UTC m=+403.439810293" watchObservedRunningTime="2026-07-28 20:51:38.606947926 +0000 UTC m=+403.441191513"
Jul 28 20:51:43.409835 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:43.409796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:43.515216 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:43.515181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:49.579450 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:49.579420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5966989555-l26n6"
Jul 28 20:51:51.253638 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.253606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:51.370097 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.370068    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:51.980470 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.980436    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p79xv"]
Jul 28 20:51:51.988481 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.988444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:51.991147 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.991111    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pfsz2\""
Jul 28 20:51:51.991147 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.991127    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 28 20:51:51.996355 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.996326    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p79xv"]
Jul 28 20:51:51.996524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.996409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28tkh\" (UniqueName: \"kubernetes.io/projected/8f74c053-9832-4008-b761-66483fc14854-kube-api-access-28tkh\") pod \"odh-model-controller-7998c67dc4-p79xv\" (UID: \"8f74c053-9832-4008-b761-66483fc14854\") " pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:51.996524 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:51.996485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f74c053-9832-4008-b761-66483fc14854-cert\") pod \"odh-model-controller-7998c67dc4-p79xv\" (UID: \"8f74c053-9832-4008-b761-66483fc14854\") " pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:52.013063 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.013036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:52.097222 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.097185    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28tkh\" (UniqueName: \"kubernetes.io/projected/8f74c053-9832-4008-b761-66483fc14854-kube-api-access-28tkh\") pod \"odh-model-controller-7998c67dc4-p79xv\" (UID: \"8f74c053-9832-4008-b761-66483fc14854\") " pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:52.097419 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.097247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f74c053-9832-4008-b761-66483fc14854-cert\") pod \"odh-model-controller-7998c67dc4-p79xv\" (UID: \"8f74c053-9832-4008-b761-66483fc14854\") " pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:52.097419 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:51:52.097360    2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 28 20:51:52.097419 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:51:52.097413    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f74c053-9832-4008-b761-66483fc14854-cert podName:8f74c053-9832-4008-b761-66483fc14854 nodeName:}" failed. No retries permitted until 2026-07-28 20:51:52.59739542 +0000 UTC m=+417.431638983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f74c053-9832-4008-b761-66483fc14854-cert") pod "odh-model-controller-7998c67dc4-p79xv" (UID: "8f74c053-9832-4008-b761-66483fc14854") : secret "odh-model-controller-webhook-cert" not found
Jul 28 20:51:52.106318 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.106285    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28tkh\" (UniqueName: \"kubernetes.io/projected/8f74c053-9832-4008-b761-66483fc14854-kube-api-access-28tkh\") pod \"odh-model-controller-7998c67dc4-p79xv\" (UID: \"8f74c053-9832-4008-b761-66483fc14854\") " pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:52.112821 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.112794    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:52.210500 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.210470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:52.437326 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.437294    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:52.601681 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.601650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f74c053-9832-4008-b761-66483fc14854-cert\") pod \"odh-model-controller-7998c67dc4-p79xv\" (UID: \"8f74c053-9832-4008-b761-66483fc14854\") " pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:52.604311 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.604270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f74c053-9832-4008-b761-66483fc14854-cert\") pod \"odh-model-controller-7998c67dc4-p79xv\" (UID: \"8f74c053-9832-4008-b761-66483fc14854\") " pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:52.734453 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.734371    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t94xs"]
Jul 28 20:51:52.737529 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.737514    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:52.740105 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.740083    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 28 20:51:52.740229 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.740130    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gsp2x\""
Jul 28 20:51:52.748393 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.748293    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t94xs"]
Jul 28 20:51:52.803989 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.803949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntfpc\" (UniqueName: \"kubernetes.io/projected/b66c1e67-12e3-4fdd-84d3-34e11df20660-kube-api-access-ntfpc\") pod \"model-serving-api-54d89bd5fc-t94xs\" (UID: \"b66c1e67-12e3-4fdd-84d3-34e11df20660\") " pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:52.804185 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.804033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66c1e67-12e3-4fdd-84d3-34e11df20660-tls-certs\") pod \"model-serving-api-54d89bd5fc-t94xs\" (UID: \"b66c1e67-12e3-4fdd-84d3-34e11df20660\") " pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:52.902239 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.902211    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:52.904560 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.904537    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntfpc\" (UniqueName: \"kubernetes.io/projected/b66c1e67-12e3-4fdd-84d3-34e11df20660-kube-api-access-ntfpc\") pod \"model-serving-api-54d89bd5fc-t94xs\" (UID: \"b66c1e67-12e3-4fdd-84d3-34e11df20660\") " pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:52.904630 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.904598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66c1e67-12e3-4fdd-84d3-34e11df20660-tls-certs\") pod \"model-serving-api-54d89bd5fc-t94xs\" (UID: \"b66c1e67-12e3-4fdd-84d3-34e11df20660\") " pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:52.904725 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:51:52.904711    2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 28 20:51:52.904833 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:51:52.904822    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b66c1e67-12e3-4fdd-84d3-34e11df20660-tls-certs podName:b66c1e67-12e3-4fdd-84d3-34e11df20660 nodeName:}" failed. No retries permitted until 2026-07-28 20:51:53.404768584 +0000 UTC m=+418.239012147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b66c1e67-12e3-4fdd-84d3-34e11df20660-tls-certs") pod "model-serving-api-54d89bd5fc-t94xs" (UID: "b66c1e67-12e3-4fdd-84d3-34e11df20660") : secret "model-serving-api-tls" not found
Jul 28 20:51:52.914924 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.914897    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntfpc\" (UniqueName: \"kubernetes.io/projected/b66c1e67-12e3-4fdd-84d3-34e11df20660-kube-api-access-ntfpc\") pod \"model-serving-api-54d89bd5fc-t94xs\" (UID: \"b66c1e67-12e3-4fdd-84d3-34e11df20660\") " pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:52.982885 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:52.982854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:53.050978 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:53.050952    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p79xv"]
Jul 28 20:51:53.053674 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:51:53.053647    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f74c053_9832_4008_b761_66483fc14854.slice/crio-36df257f3f37ef3679c82003bf29db7ceb3300e144ccea7230980f69d5de40eb WatchSource:0}: Error finding container 36df257f3f37ef3679c82003bf29db7ceb3300e144ccea7230980f69d5de40eb: Status 404 returned error can't find the container with id 36df257f3f37ef3679c82003bf29db7ceb3300e144ccea7230980f69d5de40eb
Jul 28 20:51:53.083222 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:53.083188    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:51:53.408773 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:53.408725    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66c1e67-12e3-4fdd-84d3-34e11df20660-tls-certs\") pod \"model-serving-api-54d89bd5fc-t94xs\" (UID: \"b66c1e67-12e3-4fdd-84d3-34e11df20660\") " pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:53.411471 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:53.411446    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66c1e67-12e3-4fdd-84d3-34e11df20660-tls-certs\") pod \"model-serving-api-54d89bd5fc-t94xs\" (UID: \"b66c1e67-12e3-4fdd-84d3-34e11df20660\") " pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:53.637328 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:53.637291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p79xv" event={"ID":"8f74c053-9832-4008-b761-66483fc14854","Type":"ContainerStarted","Data":"36df257f3f37ef3679c82003bf29db7ceb3300e144ccea7230980f69d5de40eb"}
Jul 28 20:51:53.649505 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:53.649471    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:53.802526 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:53.802492    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t94xs"]
Jul 28 20:51:53.806106 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:51:53.806071    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66c1e67_12e3_4fdd_84d3_34e11df20660.slice/crio-4103d11ea077d4a005aba093e33d049da7cb6acf8364a33ea4623a776306a182 WatchSource:0}: Error finding container 4103d11ea077d4a005aba093e33d049da7cb6acf8364a33ea4623a776306a182: Status 404 returned error can't find the container with id 4103d11ea077d4a005aba093e33d049da7cb6acf8364a33ea4623a776306a182
Jul 28 20:51:54.644053 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:54.644015    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t94xs" event={"ID":"b66c1e67-12e3-4fdd-84d3-34e11df20660","Type":"ContainerStarted","Data":"4103d11ea077d4a005aba093e33d049da7cb6acf8364a33ea4623a776306a182"}
Jul 28 20:51:56.655748 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:56.655710    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t94xs" event={"ID":"b66c1e67-12e3-4fdd-84d3-34e11df20660","Type":"ContainerStarted","Data":"87e7954c47660c4d81b5104e17340baea4f81c7cbdf420c94f7fa0844e53eae1"}
Jul 28 20:51:56.656246 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:56.655914    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:51:56.657279 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:56.657255    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p79xv" event={"ID":"8f74c053-9832-4008-b761-66483fc14854","Type":"ContainerStarted","Data":"62b9651069f1c69cdc7a3e32f73d12220ff8355b2c3a80af7ac76c95d80e2104"}
Jul 28 20:51:56.657392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:56.657380    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:51:56.677513 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:56.677458    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-t94xs" podStartSLOduration=2.283814778 podStartE2EDuration="4.677443245s" totalImagesPullingTime="2.393628467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:51:56.676249767 +0000 UTC m=+421.510493548" watchObservedRunningTime="2026-07-28 20:51:56.677443245 +0000 UTC m=+421.511686830"
Jul 28 20:51:56.697901 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:51:56.697845    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-p79xv" podStartSLOduration=2.543292776 podStartE2EDuration="5.697823242s" totalImagesPullingTime="3.154530466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:51:56.696830979 +0000 UTC m=+421.531074566" watchObservedRunningTime="2026-07-28 20:51:56.697823242 +0000 UTC m=+421.532066828"
Jul 28 20:52:02.351128 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.351081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:02.457035 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.457002    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"]
Jul 28 20:52:02.460371 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.460355    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.464040 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.464021    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 20:52:02.464562 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.464542    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 20:52:02.465152 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.465134    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wpjm9\""
Jul 28 20:52:02.486402 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.486370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb16501-26c7-4bc7-aab9-136a7c351c25-tmp\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.486559 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.486405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cb16501-26c7-4bc7-aab9-136a7c351c25-tls-certs\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.486559 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.486429    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwld8\" (UniqueName: \"kubernetes.io/projected/8cb16501-26c7-4bc7-aab9-136a7c351c25-kube-api-access-vwld8\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.499743 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.499714    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"]
Jul 28 20:52:02.587296 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.587256    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb16501-26c7-4bc7-aab9-136a7c351c25-tmp\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.587296 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.587300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cb16501-26c7-4bc7-aab9-136a7c351c25-tls-certs\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.587553 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.587437    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwld8\" (UniqueName: \"kubernetes.io/projected/8cb16501-26c7-4bc7-aab9-136a7c351c25-kube-api-access-vwld8\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.589668 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.589648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb16501-26c7-4bc7-aab9-136a7c351c25-tmp\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.589971 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.589953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cb16501-26c7-4bc7-aab9-136a7c351c25-tls-certs\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.601025 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.600994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:02.605455 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.605397    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwld8\" (UniqueName: \"kubernetes.io/projected/8cb16501-26c7-4bc7-aab9-136a7c351c25-kube-api-access-vwld8\") pod \"kube-auth-proxy-77d6c74c55-smc56\" (UID: \"8cb16501-26c7-4bc7-aab9-136a7c351c25\") " pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.715113 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.715082    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:02.770171 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.770133    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"]
Jul 28 20:52:02.770340 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.770218    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"
Jul 28 20:52:02.773520 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.773391    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:02.776931 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.776910    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8zm8z\""
Jul 28 20:52:02.777201 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.777185    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 20:52:02.784348 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.783102    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"]
Jul 28 20:52:02.787170 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.787145    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"]
Jul 28 20:52:02.787284 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.787276    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:02.790019 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.789998    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 20:52:02.791254 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.791236    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xb9l2\""
Jul 28 20:52:02.804385 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.804359    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"]
Jul 28 20:52:02.815623 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.815590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:02.890245 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.890206    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7de08994-053f-4fd2-96a9-5797de72164f-cert\") pod \"kserve-controller-manager-d6f4b65b8-vpscr\" (UID: \"7de08994-053f-4fd2-96a9-5797de72164f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:02.890404 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.890270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/467881e0-4ad5-45bf-aa3c-c56fa226203a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fmhqt\" (UID: \"467881e0-4ad5-45bf-aa3c-c56fa226203a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:02.890404 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.890345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmqd\" (UniqueName: \"kubernetes.io/projected/467881e0-4ad5-45bf-aa3c-c56fa226203a-kube-api-access-tpmqd\") pod \"llmisvc-controller-manager-777c6bd7d5-fmhqt\" (UID: \"467881e0-4ad5-45bf-aa3c-c56fa226203a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:02.890404 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.890372    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmh67\" (UniqueName: \"kubernetes.io/projected/7de08994-053f-4fd2-96a9-5797de72164f-kube-api-access-fmh67\") pod \"kserve-controller-manager-d6f4b65b8-vpscr\" (UID: \"7de08994-053f-4fd2-96a9-5797de72164f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:02.939425 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.939243    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77d6c74c55-smc56"]
Jul 28 20:52:02.942130 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:52:02.942098    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb16501_26c7_4bc7_aab9_136a7c351c25.slice/crio-a6c99c9cc0d2627b7e291d7eb37bc48434b8eb3eccb73b9aa4d7c81904228d4e WatchSource:0}: Error finding container a6c99c9cc0d2627b7e291d7eb37bc48434b8eb3eccb73b9aa4d7c81904228d4e: Status 404 returned error can't find the container with id a6c99c9cc0d2627b7e291d7eb37bc48434b8eb3eccb73b9aa4d7c81904228d4e
Jul 28 20:52:02.991475 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.991445    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7de08994-053f-4fd2-96a9-5797de72164f-cert\") pod \"kserve-controller-manager-d6f4b65b8-vpscr\" (UID: \"7de08994-053f-4fd2-96a9-5797de72164f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:02.991636 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.991491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/467881e0-4ad5-45bf-aa3c-c56fa226203a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fmhqt\" (UID: \"467881e0-4ad5-45bf-aa3c-c56fa226203a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:02.991636 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.991539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmqd\" (UniqueName: \"kubernetes.io/projected/467881e0-4ad5-45bf-aa3c-c56fa226203a-kube-api-access-tpmqd\") pod \"llmisvc-controller-manager-777c6bd7d5-fmhqt\" (UID: \"467881e0-4ad5-45bf-aa3c-c56fa226203a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:02.991636 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.991560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmh67\" (UniqueName: \"kubernetes.io/projected/7de08994-053f-4fd2-96a9-5797de72164f-kube-api-access-fmh67\") pod \"kserve-controller-manager-d6f4b65b8-vpscr\" (UID: \"7de08994-053f-4fd2-96a9-5797de72164f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:02.991761 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:52:02.991673    2572 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 20:52:02.991761 ip-10-0-133-57 kubenswrapper[2572]: E0728 20:52:02.991742    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/467881e0-4ad5-45bf-aa3c-c56fa226203a-cert podName:467881e0-4ad5-45bf-aa3c-c56fa226203a nodeName:}" failed. No retries permitted until 2026-07-28 20:52:03.491721119 +0000 UTC m=+428.325964698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/467881e0-4ad5-45bf-aa3c-c56fa226203a-cert") pod "llmisvc-controller-manager-777c6bd7d5-fmhqt" (UID: "467881e0-4ad5-45bf-aa3c-c56fa226203a") : secret "llmisvc-webhook-server-cert" not found
Jul 28 20:52:02.994026 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:02.994007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7de08994-053f-4fd2-96a9-5797de72164f-cert\") pod \"kserve-controller-manager-d6f4b65b8-vpscr\" (UID: \"7de08994-053f-4fd2-96a9-5797de72164f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:03.003858 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.003837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmh67\" (UniqueName: \"kubernetes.io/projected/7de08994-053f-4fd2-96a9-5797de72164f-kube-api-access-fmh67\") pod \"kserve-controller-manager-d6f4b65b8-vpscr\" (UID: \"7de08994-053f-4fd2-96a9-5797de72164f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:03.003936 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.003910    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmqd\" (UniqueName: \"kubernetes.io/projected/467881e0-4ad5-45bf-aa3c-c56fa226203a-kube-api-access-tpmqd\") pod \"llmisvc-controller-manager-777c6bd7d5-fmhqt\" (UID: \"467881e0-4ad5-45bf-aa3c-c56fa226203a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:03.013143 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.013117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:03.106820 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.106763    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:03.254760 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.254734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"]
Jul 28 20:52:03.254891 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:52:03.254863    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de08994_053f_4fd2_96a9_5797de72164f.slice/crio-9f5e4d5b83f733fd7efe937ffb551064ceec935f4a159ac115c6a58457e698dc WatchSource:0}: Error finding container 9f5e4d5b83f733fd7efe937ffb551064ceec935f4a159ac115c6a58457e698dc: Status 404 returned error can't find the container with id 9f5e4d5b83f733fd7efe937ffb551064ceec935f4a159ac115c6a58457e698dc
Jul 28 20:52:03.295121 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.295089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:03.495912 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.495811    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/467881e0-4ad5-45bf-aa3c-c56fa226203a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fmhqt\" (UID: \"467881e0-4ad5-45bf-aa3c-c56fa226203a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:03.498416 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.498391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/467881e0-4ad5-45bf-aa3c-c56fa226203a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fmhqt\" (UID: \"467881e0-4ad5-45bf-aa3c-c56fa226203a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:03.692723 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.692649    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr" event={"ID":"7de08994-053f-4fd2-96a9-5797de72164f","Type":"ContainerStarted","Data":"9f5e4d5b83f733fd7efe937ffb551064ceec935f4a159ac115c6a58457e698dc"}
Jul 28 20:52:03.694024 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.693994    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56" event={"ID":"8cb16501-26c7-4bc7-aab9-136a7c351c25","Type":"ContainerStarted","Data":"a6c99c9cc0d2627b7e291d7eb37bc48434b8eb3eccb73b9aa4d7c81904228d4e"}
Jul 28 20:52:03.722569 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.722539    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:03.892627 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:03.892593    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"]
Jul 28 20:52:03.894212 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:52:03.894184    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod467881e0_4ad5_45bf_aa3c_c56fa226203a.slice/crio-be1a7cc0189127ecb4634c077c5c3c025385c1116aee2b16b4bacc07c5e9a8b8 WatchSource:0}: Error finding container be1a7cc0189127ecb4634c077c5c3c025385c1116aee2b16b4bacc07c5e9a8b8: Status 404 returned error can't find the container with id be1a7cc0189127ecb4634c077c5c3c025385c1116aee2b16b4bacc07c5e9a8b8
Jul 28 20:52:04.048295 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:04.048172    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:04.163880 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:04.163836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:04.297362 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:04.297282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:04.702621 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:04.702213    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt" event={"ID":"467881e0-4ad5-45bf-aa3c-c56fa226203a","Type":"ContainerStarted","Data":"be1a7cc0189127ecb4634c077c5c3c025385c1116aee2b16b4bacc07c5e9a8b8"}
Jul 28 20:52:05.414091 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.414051    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"]
Jul 28 20:52:05.417919 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.417866    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.418557 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.418509    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:05.421479 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.421457    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 20:52:05.421616 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.421586    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 20:52:05.423353 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.423171    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 20:52:05.424441 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.424422    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4k98x\""
Jul 28 20:52:05.444110 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.444083    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 20:52:05.450018 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.449980    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"]
Jul 28 20:52:05.514684 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.514650    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.514684 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.514692    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61827ce2-6385-47e6-b490-3974c6f99316-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.514976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.514719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.514976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.514744    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqf25\" (UniqueName: \"kubernetes.io/projected/61827ce2-6385-47e6-b490-3974c6f99316-kube-api-access-lqf25\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.514976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.514851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61827ce2-6385-47e6-b490-3974c6f99316-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.514976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.514882    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61827ce2-6385-47e6-b490-3974c6f99316-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.514976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.514955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.615659 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.615612    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61827ce2-6385-47e6-b490-3974c6f99316-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.615898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.615695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.615898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.615726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.615898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.615752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61827ce2-6385-47e6-b490-3974c6f99316-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.615898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.615774    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.615898 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.615804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqf25\" (UniqueName: \"kubernetes.io/projected/61827ce2-6385-47e6-b490-3974c6f99316-kube-api-access-lqf25\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.616179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.616059    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61827ce2-6385-47e6-b490-3974c6f99316-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.616904 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.616875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61827ce2-6385-47e6-b490-3974c6f99316-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.618516 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.618492    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61827ce2-6385-47e6-b490-3974c6f99316-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.618709 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.618662    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.618944 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.618920    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.619019 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.618981    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61827ce2-6385-47e6-b490-3974c6f99316-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.636272 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.635619    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqf25\" (UniqueName: \"kubernetes.io/projected/61827ce2-6385-47e6-b490-3974c6f99316-kube-api-access-lqf25\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.637217 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.637189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61827ce2-6385-47e6-b490-3974c6f99316-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pz96k\" (UID: \"61827ce2-6385-47e6-b490-3974c6f99316\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:05.642606 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.642427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:05.731209 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:05.731117    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:06.874458 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:06.874428    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"]
Jul 28 20:52:07.096427 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.096396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:07.318368 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:52:07.318333    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61827ce2_6385_47e6_b490_3974c6f99316.slice/crio-9e1fc9ac8db1e8c04f37410790fab8a74f0c0233e56c46f66ec72237d1c0d588 WatchSource:0}: Error finding container 9e1fc9ac8db1e8c04f37410790fab8a74f0c0233e56c46f66ec72237d1c0d588: Status 404 returned error can't find the container with id 9e1fc9ac8db1e8c04f37410790fab8a74f0c0233e56c46f66ec72237d1c0d588
Jul 28 20:52:07.665153 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.665122    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-p79xv"
Jul 28 20:52:07.667032 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.667010    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-t94xs"
Jul 28 20:52:07.719452 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.719397    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56" event={"ID":"8cb16501-26c7-4bc7-aab9-136a7c351c25","Type":"ContainerStarted","Data":"b3c2c110e3304d32fcaa902f6b27bcdb2f7cbf11d2015496fb0fabbc9118707f"}
Jul 28 20:52:07.721007 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.720978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr" event={"ID":"7de08994-053f-4fd2-96a9-5797de72164f","Type":"ContainerStarted","Data":"eac034217f6eb5715b5d6a73a0602287e89ec48098c7d4d9536110ba8a26d668"}
Jul 28 20:52:07.721143 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.721044    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:07.722243 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.722220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k" event={"ID":"61827ce2-6385-47e6-b490-3974c6f99316","Type":"ContainerStarted","Data":"9e1fc9ac8db1e8c04f37410790fab8a74f0c0233e56c46f66ec72237d1c0d588"}
Jul 28 20:52:07.723907 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.723857    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt" event={"ID":"467881e0-4ad5-45bf-aa3c-c56fa226203a","Type":"ContainerStarted","Data":"c29705ec8355dfee1f0e304badc9c3c5ddf5d4204b6fae5b3d27d17754d3c3e4"}
Jul 28 20:52:07.724030 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.724012    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:07.789447 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.789387    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr" podStartSLOduration=2.416825884 podStartE2EDuration="5.789367669s" totalImagesPullingTime="3.372541785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:07.787992873 +0000 UTC m=+432.622236460" watchObservedRunningTime="2026-07-28 20:52:07.789367669 +0000 UTC m=+432.623611299"
Jul 28 20:52:07.821128 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.821067    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt" podStartSLOduration=2.342020857 podStartE2EDuration="5.82104639s" totalImagesPullingTime="3.479025533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:07.818305058 +0000 UTC m=+432.652548643" watchObservedRunningTime="2026-07-28 20:52:07.82104639 +0000 UTC m=+432.655290021"
Jul 28 20:52:07.847235 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:07.847178    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77d6c74c55-smc56" podStartSLOduration=2.162263088 podStartE2EDuration="5.847160676s" totalImagesPullingTime="3.684897588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:07.846608043 +0000 UTC m=+432.680851630" watchObservedRunningTime="2026-07-28 20:52:07.847160676 +0000 UTC m=+432.681404262"
Jul 28 20:52:10.427547 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:10.427505    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 20:52:10.427791 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:10.427596    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 20:52:10.741408 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:10.741318    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k" event={"ID":"61827ce2-6385-47e6-b490-3974c6f99316","Type":"ContainerStarted","Data":"2453ee911b1771a15043c7f1ce615708a6bcf3e7fa693b0bef48f27ae5975eb2"}
Jul 28 20:52:10.741575 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:10.741457    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:10.770713 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:10.770639    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k" podStartSLOduration=2.666658908 podStartE2EDuration="5.770621742s" totalImagesPullingTime="3.103962834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:10.769265747 +0000 UTC m=+435.603509334" watchObservedRunningTime="2026-07-28 20:52:10.770621742 +0000 UTC m=+435.604865328"
Jul 28 20:52:11.178120 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:11.178082    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:11.306884 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:11.306849    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:11.746155 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:11.746116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:11.747856 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:11.747833    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k"
Jul 28 20:52:11.899277 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:11.899241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:12.022093 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:12.021984    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:38.736860 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:38.736758    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fmhqt"
Jul 28 20:52:38.740043 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:38.740023    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vpscr"
Jul 28 20:52:42.478612 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:42.478577    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:49.699580 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:49.699544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:49.748994 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:49.748948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:52.876182 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:52.876097    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:52.977740 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:52.977701    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:52:53.084232 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:52:53.084200    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:08.481243 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:08.481197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:08.533222 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:08.533182    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:11.250529 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:11.250488    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:11.351959 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:11.351920    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:19.458651 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:19.458612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:19.559976 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:19.559939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:22.392180 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:22.392129    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:25.877017 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:25.876978    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:28.913617 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:28.913580    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:30.365928 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:30.365888    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:30.678052 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:30.678009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:31.263399 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:31.263358    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:34.329495 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:34.329460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:34.672705 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:34.672668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:36.635822 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:36.635763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:38.075014 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:38.074981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:38.176048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:38.176008    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:40.743472 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:40.743441    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:40.929029 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:40.928996    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:41.669336 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:41.669303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:41.721296 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:41.721265    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:50.938568 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:50.938487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:51.038041 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.038009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:51.517835 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.517797    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"]
Jul 28 20:53:51.521178 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.521150    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"
Jul 28 20:53:51.524263 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.524235    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wlfhb\""
Jul 28 20:53:51.524489 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.524472    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 20:53:51.525545 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.525523    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 20:53:51.532631 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.532605    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"]
Jul 28 20:53:51.630107 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.630066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n8zp\" (UniqueName: \"kubernetes.io/projected/6a9107f1-9919-4911-ac2b-0583d2ce6f72-kube-api-access-4n8zp\") pod \"limitador-operator-controller-manager-859d7b78bd-5vdkc\" (UID: \"6a9107f1-9919-4911-ac2b-0583d2ce6f72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"
Jul 28 20:53:51.731355 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.731306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n8zp\" (UniqueName: \"kubernetes.io/projected/6a9107f1-9919-4911-ac2b-0583d2ce6f72-kube-api-access-4n8zp\") pod \"limitador-operator-controller-manager-859d7b78bd-5vdkc\" (UID: \"6a9107f1-9919-4911-ac2b-0583d2ce6f72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"
Jul 28 20:53:51.741129 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.741091    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n8zp\" (UniqueName: \"kubernetes.io/projected/6a9107f1-9919-4911-ac2b-0583d2ce6f72-kube-api-access-4n8zp\") pod \"limitador-operator-controller-manager-859d7b78bd-5vdkc\" (UID: \"6a9107f1-9919-4911-ac2b-0583d2ce6f72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"
Jul 28 20:53:51.833873 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.833743    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"
Jul 28 20:53:51.971705 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:51.971678    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"]
Jul 28 20:53:51.974656 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:53:51.974628    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9107f1_9919_4911_ac2b_0583d2ce6f72.slice/crio-46f409bf331da48c8ceabf1d6cc63e9bb731a4acc64a986e5ede2f62d1b18da7 WatchSource:0}: Error finding container 46f409bf331da48c8ceabf1d6cc63e9bb731a4acc64a986e5ede2f62d1b18da7: Status 404 returned error can't find the container with id 46f409bf331da48c8ceabf1d6cc63e9bb731a4acc64a986e5ede2f62d1b18da7
Jul 28 20:53:52.203843 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:52.203809    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc" event={"ID":"6a9107f1-9919-4911-ac2b-0583d2ce6f72","Type":"ContainerStarted","Data":"46f409bf331da48c8ceabf1d6cc63e9bb731a4acc64a986e5ede2f62d1b18da7"}
Jul 28 20:53:53.913742 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:53.913703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:54.014422 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:54.014393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:54.215690 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:54.215594    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc" event={"ID":"6a9107f1-9919-4911-ac2b-0583d2ce6f72","Type":"ContainerStarted","Data":"54565c2fb65154f534f4cd04330a05b2a4952140869217279347b54872b03ef0"}
Jul 28 20:53:54.215888 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:54.215712    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"
Jul 28 20:53:54.235752 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:54.235699    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc" podStartSLOduration=1.222868686 podStartE2EDuration="3.235681159s" totalImagesPullingTime="2.012812473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:53:54.233550511 +0000 UTC m=+539.067794097" watchObservedRunningTime="2026-07-28 20:53:54.235681159 +0000 UTC m=+539.069924744"
Jul 28 20:53:56.493300 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:56.493242    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:56.594215 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:56.594182    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:57.035736 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:57.035702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:53:57.187210 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:53:57.187179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:00.097924 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:00.097885    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:00.232911 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:00.232875    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:05.222750 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:05.222718    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vdkc"
Jul 28 20:54:06.692802 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:06.692750    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:06.810161 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:06.810130    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:09.304533 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:09.304494    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:09.401179 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:09.401139    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:12.300635 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:12.300591    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:12.402106 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:12.402063    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:20.219188 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:20.219153    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:21.498100 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:21.498069    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:34.454037 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:34.454003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:34.566970 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:34.566932    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:34.625059 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:34.625016    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:35.395262 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:35.395227    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:35.495529 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:35.495490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:53.587055 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:53.587019    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:53.693747 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:53.693717    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:54.140302 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:54.140267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:54:55.627188 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:55.627160    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:54:55.642894 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:54:55.642868    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:55:02.615266 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:02.615226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:07.400085 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:07.400041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:07.515759 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:07.515721    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:15.231304 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:15.231272    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:15.331486 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:15.331452    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:15.383774 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:15.383738    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:15.754182 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:15.754143    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:19.696037 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:19.696001    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:19.813652 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:19.813617    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:50.802951 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:50.802912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:50.894966 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:50.894933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:51.383149 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.383115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:51.447376 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.447333    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"]
Jul 28 20:55:51.450871 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.450845    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.454428 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.454403    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 28 20:55:51.454668 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.454652    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sz5mx\""
Jul 28 20:55:51.455552 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.455535    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:55:51.455684 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.455565    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:55:51.463823 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.463796    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"]
Jul 28 20:55:51.543248 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.543212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efc3cc72-8cd5-4a88-b91c-83a7e6534596-maas-api-tls\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.543452 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.543268    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5c9\" (UniqueName: \"kubernetes.io/projected/efc3cc72-8cd5-4a88-b91c-83a7e6534596-kube-api-access-mn5c9\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.543452 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.543309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efc3cc72-8cd5-4a88-b91c-83a7e6534596-openshift-service-ca\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.644851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.644743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5c9\" (UniqueName: \"kubernetes.io/projected/efc3cc72-8cd5-4a88-b91c-83a7e6534596-kube-api-access-mn5c9\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.644851 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.644826    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efc3cc72-8cd5-4a88-b91c-83a7e6534596-openshift-service-ca\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.645048 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.644890    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efc3cc72-8cd5-4a88-b91c-83a7e6534596-maas-api-tls\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.645561 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.645543    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efc3cc72-8cd5-4a88-b91c-83a7e6534596-openshift-service-ca\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.647653 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.647631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efc3cc72-8cd5-4a88-b91c-83a7e6534596-maas-api-tls\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.652798 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.652757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5c9\" (UniqueName: \"kubernetes.io/projected/efc3cc72-8cd5-4a88-b91c-83a7e6534596-kube-api-access-mn5c9\") pod \"maas-api-67cd878d8b-6znx8\" (UID: \"efc3cc72-8cd5-4a88-b91c-83a7e6534596\") " pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.762198 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.762167    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:51.915425 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.915392    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"]
Jul 28 20:55:51.918267 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:55:51.918237    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc3cc72_8cd5_4a88_b91c_83a7e6534596.slice/crio-88cb96d0119024e4c9c2eab645e6c3e05fe73a5ebb473c8b821bf02ea393dad2 WatchSource:0}: Error finding container 88cb96d0119024e4c9c2eab645e6c3e05fe73a5ebb473c8b821bf02ea393dad2: Status 404 returned error can't find the container with id 88cb96d0119024e4c9c2eab645e6c3e05fe73a5ebb473c8b821bf02ea393dad2
Jul 28 20:55:51.991690 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:51.991658    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:52.038824 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.038765    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"]
Jul 28 20:55:52.043554 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.043525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.046130 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.046103    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 20:55:52.046288 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.046229    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ls7ns\""
Jul 28 20:55:52.053601 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.053576    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"]
Jul 28 20:55:52.073867 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.073824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:55:52.149210 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.149173    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c807f182-81ff-4345-a152-f7c5c94e702a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-wsscd\" (UID: \"c807f182-81ff-4345-a152-f7c5c94e702a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.149372 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.149256    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcmdv\" (UniqueName: \"kubernetes.io/projected/c807f182-81ff-4345-a152-f7c5c94e702a-kube-api-access-tcmdv\") pod \"payload-pre-processing-687dbb6cf6-wsscd\" (UID: \"c807f182-81ff-4345-a152-f7c5c94e702a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.250576 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.250482    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcmdv\" (UniqueName: \"kubernetes.io/projected/c807f182-81ff-4345-a152-f7c5c94e702a-kube-api-access-tcmdv\") pod \"payload-pre-processing-687dbb6cf6-wsscd\" (UID: \"c807f182-81ff-4345-a152-f7c5c94e702a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.250576 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.250551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c807f182-81ff-4345-a152-f7c5c94e702a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-wsscd\" (UID: \"c807f182-81ff-4345-a152-f7c5c94e702a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.251346 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.251324    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c807f182-81ff-4345-a152-f7c5c94e702a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-wsscd\" (UID: \"c807f182-81ff-4345-a152-f7c5c94e702a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.258854 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.258824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcmdv\" (UniqueName: \"kubernetes.io/projected/c807f182-81ff-4345-a152-f7c5c94e702a-kube-api-access-tcmdv\") pod \"payload-pre-processing-687dbb6cf6-wsscd\" (UID: \"c807f182-81ff-4345-a152-f7c5c94e702a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.355182 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.355140    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:52.498984 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.498957    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"]
Jul 28 20:55:52.501424 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:55:52.501350    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc807f182_81ff_4345_a152_f7c5c94e702a.slice/crio-d02559f56c25c92e525b4b00f7371d13a730bb2d8f51c9198c32b7000428e651 WatchSource:0}: Error finding container d02559f56c25c92e525b4b00f7371d13a730bb2d8f51c9198c32b7000428e651: Status 404 returned error can't find the container with id d02559f56c25c92e525b4b00f7371d13a730bb2d8f51c9198c32b7000428e651
Jul 28 20:55:52.775156 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.775063    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8" event={"ID":"efc3cc72-8cd5-4a88-b91c-83a7e6534596","Type":"ContainerStarted","Data":"88cb96d0119024e4c9c2eab645e6c3e05fe73a5ebb473c8b821bf02ea393dad2"}
Jul 28 20:55:52.776431 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:52.776402    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd" event={"ID":"c807f182-81ff-4345-a152-f7c5c94e702a","Type":"ContainerStarted","Data":"d02559f56c25c92e525b4b00f7371d13a730bb2d8f51c9198c32b7000428e651"}
Jul 28 20:55:55.793267 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:55.793229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd" event={"ID":"c807f182-81ff-4345-a152-f7c5c94e702a","Type":"ContainerStarted","Data":"26446659b9e2c7fdf900f048b9672de9c89487b82c13828b5d576e953d362bb1"}
Jul 28 20:55:55.793721 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:55.793294    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:55:55.794881 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:55.794851    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8" event={"ID":"efc3cc72-8cd5-4a88-b91c-83a7e6534596","Type":"ContainerStarted","Data":"f23cb2977bbf5e3a286dada5a9684c48b94ce43146ee16d5c83bd6104e3e8b4b"}
Jul 28 20:55:55.794983 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:55.794974    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:55:55.808283 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:55.808233    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd" podStartSLOduration=0.905774806 podStartE2EDuration="3.808218485s" totalImagesPullingTime="2.902443679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:55:55.807250951 +0000 UTC m=+660.641494548" watchObservedRunningTime="2026-07-28 20:55:55.808218485 +0000 UTC m=+660.642462071"
Jul 28 20:55:55.824488 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:55:55.824433    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8" podStartSLOduration=1.3876673990000001 podStartE2EDuration="4.824414968s" totalImagesPullingTime="3.436747569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:55:55.822539983 +0000 UTC m=+660.656783574" watchObservedRunningTime="2026-07-28 20:55:55.824414968 +0000 UTC m=+660.658658552"
Jul 28 20:56:01.805879 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:01.805850    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67cd878d8b-6znx8"
Jul 28 20:56:02.822331 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:02.822303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:56:02.922480 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:02.922446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:56:06.802313 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:06.802282    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd"
Jul 28 20:56:19.235912 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.235881    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"]
Jul 28 20:56:19.239182 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.239164    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.241746 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.241719    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 28 20:56:19.242879 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.242859    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 20:56:19.242962 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.242893    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 20:56:19.242962 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.242922    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hkgj4\""
Jul 28 20:56:19.249081 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.249053    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"]
Jul 28 20:56:19.257821 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.257765    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:56:19.383728 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.383684    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212540bb-e908-4c73-b8a5-269ec243866d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.383948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.383748    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz95j\" (UniqueName: \"kubernetes.io/projected/212540bb-e908-4c73-b8a5-269ec243866d-kube-api-access-vz95j\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.383948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.383874    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.383948 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.383932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.384068 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.384012    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.384068 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.384054    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.484855 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.484808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485041 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.484881    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485041 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.484905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485041 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.484933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485041 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.484957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212540bb-e908-4c73-b8a5-269ec243866d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485041 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.484990    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz95j\" (UniqueName: \"kubernetes.io/projected/212540bb-e908-4c73-b8a5-269ec243866d-kube-api-access-vz95j\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485359 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.485322    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485439 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.485370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.485439 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.485381    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.487450 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.487392    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212540bb-e908-4c73-b8a5-269ec243866d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.487678 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.487659    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212540bb-e908-4c73-b8a5-269ec243866d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.495910 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.495884    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz95j\" (UniqueName: \"kubernetes.io/projected/212540bb-e908-4c73-b8a5-269ec243866d-kube-api-access-vz95j\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8\" (UID: \"212540bb-e908-4c73-b8a5-269ec243866d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.551223 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.551186    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:19.702716 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.702683    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"]
Jul 28 20:56:19.705452 ip-10-0-133-57 kubenswrapper[2572]: W0728 20:56:19.705420    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212540bb_e908_4c73_b8a5_269ec243866d.slice/crio-4f990ed78e08291feff61046bf348dd6f04ade3bdcfc2032c99684193c689f58 WatchSource:0}: Error finding container 4f990ed78e08291feff61046bf348dd6f04ade3bdcfc2032c99684193c689f58: Status 404 returned error can't find the container with id 4f990ed78e08291feff61046bf348dd6f04ade3bdcfc2032c99684193c689f58
Jul 28 20:56:19.906770 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:19.906737    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8" event={"ID":"212540bb-e908-4c73-b8a5-269ec243866d","Type":"ContainerStarted","Data":"4f990ed78e08291feff61046bf348dd6f04ade3bdcfc2032c99684193c689f58"}
Jul 28 20:56:20.913636 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:20.913600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8" event={"ID":"212540bb-e908-4c73-b8a5-269ec243866d","Type":"ContainerStarted","Data":"922b227a57e68d854a8bdd71b37083e6f1b61924402e9bb47f03edca03dc0419"}
Jul 28 20:56:20.932325 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:20.932271    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8" podStartSLOduration=0.848372444 podStartE2EDuration="1.932253338s" totalImagesPullingTime="1.083880894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:56:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:56:20.930365713 +0000 UTC m=+685.764609297" watchObservedRunningTime="2026-07-28 20:56:20.932253338 +0000 UTC m=+685.766496924"
Jul 28 20:56:29.552425 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:29.552383    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:29.552867 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:29.552453    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:29.565061 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:29.565029    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:29.966404 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:29.966375    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8"
Jul 28 20:56:33.674172 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:33.674137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:56:44.261297 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:44.261261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:56:53.164875 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:53.164774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:56:58.930170 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:58.930139    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:56:58.978590 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:56:58.978559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:57:02.567937 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:57:02.567907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:57:06.861051 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:57:06.861016    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:57:48.398150 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:57:48.398116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:57:48.495023 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:57:48.494991    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:57:49.512392 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:57:49.512358    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:57:49.612478 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:57:49.612432    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:58:23.782999 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:58:23.782909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:59:03.537365 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:59:03.537314    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:59:55.656653 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:59:55.656582    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:59:55.678049 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:59:55.678010    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 20:59:55.890937 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:59:55.890904    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 20:59:57.091379 ip-10-0-133-57 kubenswrapper[2572]: I0728 20:59:57.091343    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:00.145457 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.145422    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v"]
Jul 28 21:00:00.148972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.148955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v"
Jul 28 21:00:00.151518 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.151495    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wt6gl\""
Jul 28 21:00:00.156544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.156513    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v"]
Jul 28 21:00:00.160168 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.160146    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v"
Jul 28 21:00:00.510459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.510372    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v"]
Jul 28 21:00:00.513382 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:00:00.513351    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bf2f80_9505_4a0d_ba9b_71443f528f10.slice/crio-19a0176d684431685ee106617b077f6257a4ed03ed55348ca6e9df6a1c3bbe1a WatchSource:0}: Error finding container 19a0176d684431685ee106617b077f6257a4ed03ed55348ca6e9df6a1c3bbe1a: Status 404 returned error can't find the container with id 19a0176d684431685ee106617b077f6257a4ed03ed55348ca6e9df6a1c3bbe1a
Jul 28 21:00:00.515308 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.515292    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 21:00:00.944202 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:00.944166    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v" event={"ID":"b1bf2f80-9505-4a0d-ba9b-71443f528f10","Type":"ContainerStarted","Data":"19a0176d684431685ee106617b077f6257a4ed03ed55348ca6e9df6a1c3bbe1a"}
Jul 28 21:00:04.966644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:04.966609    2572 generic.go:356] "Generic (PLEG): container finished" podID="b1bf2f80-9505-4a0d-ba9b-71443f528f10" containerID="55dddc2784025f478befdc79e7a9c140d7e121db70038ef6c67f14bd6874c679" exitCode=0
Jul 28 21:00:04.967106 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:04.966694    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v" event={"ID":"b1bf2f80-9505-4a0d-ba9b-71443f528f10","Type":"ContainerDied","Data":"55dddc2784025f478befdc79e7a9c140d7e121db70038ef6c67f14bd6874c679"}
Jul 28 21:00:06.111634 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:06.111611    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v"
Jul 28 21:00:06.977507 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:06.977478    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v"
Jul 28 21:00:06.977711 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:06.977472    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754540-wzq9v" event={"ID":"b1bf2f80-9505-4a0d-ba9b-71443f528f10","Type":"ContainerDied","Data":"19a0176d684431685ee106617b077f6257a4ed03ed55348ca6e9df6a1c3bbe1a"}
Jul 28 21:00:06.977711 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:06.977605    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19a0176d684431685ee106617b077f6257a4ed03ed55348ca6e9df6a1c3bbe1a"
Jul 28 21:00:32.720026 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:32.719979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:34.720184 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:34.720150    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:35.859372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:35.859334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:40.951975 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:40.951935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:41.057146 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:41.057110    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:41.159373 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:41.159342    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:41.326417 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:41.326324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:47.832324 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:47.832286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:47.933423 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:47.933395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:00:56.846047 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:00:56.846006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:02:57.913871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:02:57.913761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:02:58.000970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:02:58.000932    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:04:34.138208 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:04:34.138125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:04:45.613740 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:04:45.613701    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:04:55.693479 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:04:55.693443    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:04:55.707378 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:04:55.707357    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:08:44.193765 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:08:44.193723    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:08:53.560381 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:08:53.560267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:09:23.910061 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:09:23.910028    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:09:24.267791 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:09:24.267696    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:09:55.723432 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:09:55.723404    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:09:55.735882 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:09:55.735854    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:10:16.182192 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:10:16.182112    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:10:57.621088 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:10:57.621053    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:11:15.894498 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:11:15.894453    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:11:15.994848 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:11:15.994812    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:27.485636 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:27.485607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:47.135086 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:47.135041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:47.235216 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:47.235171    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:49.496466 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:49.496429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:52.887396 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:52.887341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:52.981638 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:52.981608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:53.431828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:53.431768    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:59.310773 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.310734    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:59.374338 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.374307    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:59.561890 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.561767    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:12:59.911888 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.911842    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"]
Jul 28 21:12:59.912489 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.912467    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bf2f80-9505-4a0d-ba9b-71443f528f10" containerName="cleanup"
Jul 28 21:12:59.912579 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.912492    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bf2f80-9505-4a0d-ba9b-71443f528f10" containerName="cleanup"
Jul 28 21:12:59.912579 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.912568    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bf2f80-9505-4a0d-ba9b-71443f528f10" containerName="cleanup"
Jul 28 21:12:59.915239 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.915220    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:12:59.917874 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.917845    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b71fef06-openshift-default-dockercfg-8m6pl\""
Jul 28 21:12:59.944322 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.944291    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"]
Jul 28 21:12:59.946667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:12:59.946621    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:00.012441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012393    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-socket\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.012441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012444    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-envoy\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.012441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-token\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.012836 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a16f76-1d6f-412f-823f-87f40e16c77f-istiod-ca-cert\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.012836 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-credential-socket\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.012836 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012654    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6vvn\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-kube-api-access-k6vvn\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.012836 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-podinfo\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.012836 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012720    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-certs\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.013046 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.012865    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-data\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.047358 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.047319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:00.114222 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-certs\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114245    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-data\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114282    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-socket\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-envoy\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-token\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a16f76-1d6f-412f-823f-87f40e16c77f-istiod-ca-cert\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114401    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-credential-socket\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114754 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114450    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6vvn\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-kube-api-access-k6vvn\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114754 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114490    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-podinfo\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114754 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114693    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-certs\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114949 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114813    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-socket\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.114949 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.114896    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-data\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.115061 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.115040    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-credential-socket\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.115352 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.115294    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a16f76-1d6f-412f-823f-87f40e16c77f-istiod-ca-cert\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.117073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.117045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-envoy\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.117191 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.117103    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-podinfo\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.122739 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.122712    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-token\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.122933 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.122879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6vvn\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-kube-api-access-k6vvn\") pod \"e2e-ait-b71fef06-openshift-default-5496664854-rglmd\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") " pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.227146 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.227054    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:00.373638 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.373611    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"]
Jul 28 21:13:00.375607 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:13:00.375582    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a16f76_1d6f_412f_823f_87f40e16c77f.slice/crio-f85ecdcf61924d4e25603f075eab0566cfba36ac0a93b15e03df7d1360a161ea WatchSource:0}: Error finding container f85ecdcf61924d4e25603f075eab0566cfba36ac0a93b15e03df7d1360a161ea: Status 404 returned error can't find the container with id f85ecdcf61924d4e25603f075eab0566cfba36ac0a93b15e03df7d1360a161ea
Jul 28 21:13:00.378121 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.378101    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 21:13:00.668032 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:00.667997    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" event={"ID":"66a16f76-1d6f-412f-823f-87f40e16c77f","Type":"ContainerStarted","Data":"f85ecdcf61924d4e25603f075eab0566cfba36ac0a93b15e03df7d1360a161ea"}
Jul 28 21:13:02.973275 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:02.973232    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:02.973614 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:02.973310    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:02.973614 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:02.973350    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:03.686852 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:03.686809    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" event={"ID":"66a16f76-1d6f-412f-823f-87f40e16c77f","Type":"ContainerStarted","Data":"454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44"}
Jul 28 21:13:03.707665 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:03.707607    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" podStartSLOduration=2.112973485 podStartE2EDuration="4.707589538s" totalImagesPullingTime="2.594616053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:03.7056355 +0000 UTC m=+1688.539879088" watchObservedRunningTime="2026-07-28 21:13:03.707589538 +0000 UTC m=+1688.541833123"
Jul 28 21:13:04.227743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:04.227702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:04.232873 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:04.232846    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:04.691264 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:04.691235    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:04.692328 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:04.692310    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:05.138151 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.138122    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:05.184859 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.184823    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"]
Jul 28 21:13:05.188402 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.188379    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.192171 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.192141    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"]
Jul 28 21:13:05.192357 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.192244    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b71fef06-serving-cert\""
Jul 28 21:13:05.240046 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.240014    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:05.369773 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.369733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4tvk\" (UniqueName: \"kubernetes.io/projected/a808bcb2-c379-46dc-9bc8-36727b57d751-kube-api-access-f4tvk\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.369972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.369916    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.369972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.369945    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a808bcb2-c379-46dc-9bc8-36727b57d751-openshift-service-ca\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.471128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.471040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.471128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.471078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a808bcb2-c379-46dc-9bc8-36727b57d751-openshift-service-ca\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.471128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.471117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4tvk\" (UniqueName: \"kubernetes.io/projected/a808bcb2-c379-46dc-9bc8-36727b57d751-kube-api-access-f4tvk\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.471347 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:05.471199    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-serving-cert: secret "maas-api-e2e-ait-b71fef06-serving-cert" not found
Jul 28 21:13:05.471347 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:05.471274    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls podName:a808bcb2-c379-46dc-9bc8-36727b57d751 nodeName:}" failed. No retries permitted until 2026-07-28 21:13:05.97125551 +0000 UTC m=+1690.805499077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls") pod "maas-api-e2e-ait-b71fef06-754d5df584-rk7g4" (UID: "a808bcb2-c379-46dc-9bc8-36727b57d751") : secret "maas-api-e2e-ait-b71fef06-serving-cert" not found
Jul 28 21:13:05.471722 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.471705    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a808bcb2-c379-46dc-9bc8-36727b57d751-openshift-service-ca\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.487723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.487683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4tvk\" (UniqueName: \"kubernetes.io/projected/a808bcb2-c379-46dc-9bc8-36727b57d751-kube-api-access-f4tvk\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.702921 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.702884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:05.841231 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.841141    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:05.937419 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.937385    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:05.942117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.942088    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"]
Jul 28 21:13:05.945817 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.945770    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:05.948497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.948468    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b71fef06\""
Jul 28 21:13:05.948630 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.948589    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b71fef06-dockercfg-k4n6w\""
Jul 28 21:13:05.954580 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.954555    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"]
Jul 28 21:13:05.971040 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.971009    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"]
Jul 28 21:13:05.974943 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.974908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:05.975590 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.975564    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.978301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.978277    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls\") pod \"maas-api-e2e-ait-b71fef06-754d5df584-rk7g4\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:05.984498 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:05.984472    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"]
Jul 28 21:13:06.077081 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.077035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f4a5a5-8487-4208-83a9-44ea508808c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") " pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.077278 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.077104    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s6zs\" (UniqueName: \"kubernetes.io/projected/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-kube-api-access-4s6zs\") pod \"payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.077278 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.077171    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nptzz\" (UniqueName: \"kubernetes.io/projected/83f4a5a5-8487-4208-83a9-44ea508808c2-kube-api-access-nptzz\") pod \"payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") " pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.077278 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.077227    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.101517 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.101431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:06.178495 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.178462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6zs\" (UniqueName: \"kubernetes.io/projected/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-kube-api-access-4s6zs\") pod \"payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.178646 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.178526    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nptzz\" (UniqueName: \"kubernetes.io/projected/83f4a5a5-8487-4208-83a9-44ea508808c2-kube-api-access-nptzz\") pod \"payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") " pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.178646 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.178552    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.178646 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.178591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f4a5a5-8487-4208-83a9-44ea508808c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") " pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.179434 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.179412    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f4a5a5-8487-4208-83a9-44ea508808c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") " pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.179434 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.179425    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.186938 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.186909    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s6zs\" (UniqueName: \"kubernetes.io/projected/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-kube-api-access-4s6zs\") pod \"payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.187075 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.186990    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nptzz\" (UniqueName: \"kubernetes.io/projected/83f4a5a5-8487-4208-83a9-44ea508808c2-kube-api-access-nptzz\") pod \"payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") " pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.250735 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.250705    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"]
Jul 28 21:13:06.252377 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:13:06.252351    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda808bcb2_c379_46dc_9bc8_36727b57d751.slice/crio-6ab4f6b5a2c67317d5182a833d0e4426a984369cbaa716d9e19f7bd51be4171d WatchSource:0}: Error finding container 6ab4f6b5a2c67317d5182a833d0e4426a984369cbaa716d9e19f7bd51be4171d: Status 404 returned error can't find the container with id 6ab4f6b5a2c67317d5182a833d0e4426a984369cbaa716d9e19f7bd51be4171d
Jul 28 21:13:06.258302 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.258281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.300241 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.300206    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.410236 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.410213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"]
Jul 28 21:13:06.412860 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:13:06.412825    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1daca6e1_2e9c_4d9f_840b_76dc2bc5a5b7.slice/crio-a09feed3d1ae020f89e72d71bfeb58071e08862fab0810b94388de441b080532 WatchSource:0}: Error finding container a09feed3d1ae020f89e72d71bfeb58071e08862fab0810b94388de441b080532: Status 404 returned error can't find the container with id a09feed3d1ae020f89e72d71bfeb58071e08862fab0810b94388de441b080532
Jul 28 21:13:06.457041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.457019    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"]
Jul 28 21:13:06.459437 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:13:06.459414    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f4a5a5_8487_4208_83a9_44ea508808c2.slice/crio-905053b801b05ada20913244899ae86e0adf78e84f166f82a7abd4b322169c02 WatchSource:0}: Error finding container 905053b801b05ada20913244899ae86e0adf78e84f166f82a7abd4b322169c02: Status 404 returned error can't find the container with id 905053b801b05ada20913244899ae86e0adf78e84f166f82a7abd4b322169c02
Jul 28 21:13:06.704344 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.704303    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6" event={"ID":"83f4a5a5-8487-4208-83a9-44ea508808c2","Type":"ContainerStarted","Data":"3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050"}
Jul 28 21:13:06.704553 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.704385    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6" event={"ID":"83f4a5a5-8487-4208-83a9-44ea508808c2","Type":"ContainerStarted","Data":"905053b801b05ada20913244899ae86e0adf78e84f166f82a7abd4b322169c02"}
Jul 28 21:13:06.704553 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.704418    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:06.706009 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.705984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h" event={"ID":"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7","Type":"ContainerStarted","Data":"2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3"}
Jul 28 21:13:06.706147 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.706035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:06.706147 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.706061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h" event={"ID":"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7","Type":"ContainerStarted","Data":"a09feed3d1ae020f89e72d71bfeb58071e08862fab0810b94388de441b080532"}
Jul 28 21:13:06.707193 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.707171    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4" event={"ID":"a808bcb2-c379-46dc-9bc8-36727b57d751","Type":"ContainerStarted","Data":"6ab4f6b5a2c67317d5182a833d0e4426a984369cbaa716d9e19f7bd51be4171d"}
Jul 28 21:13:06.722124 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.722066    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6" podStartSLOduration=1.7220505529999999 podStartE2EDuration="1.722050553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:13:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:06.721145364 +0000 UTC m=+1691.555388955" watchObservedRunningTime="2026-07-28 21:13:06.722050553 +0000 UTC m=+1691.556294139"
Jul 28 21:13:06.736669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:06.736611    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h" podStartSLOduration=1.736593128 podStartE2EDuration="1.736593128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:13:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:06.735772 +0000 UTC m=+1691.570015586" watchObservedRunningTime="2026-07-28 21:13:06.736593128 +0000 UTC m=+1691.570836709"
Jul 28 21:13:07.720371 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:07.720333    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4" event={"ID":"a808bcb2-c379-46dc-9bc8-36727b57d751","Type":"ContainerStarted","Data":"b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed"}
Jul 28 21:13:07.720977 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:07.720952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:07.737910 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:07.737852    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4" podStartSLOduration=2.154941802 podStartE2EDuration="2.737839266s" totalImagesPullingTime="582.897464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:07.736007566 +0000 UTC m=+1692.570251153" watchObservedRunningTime="2026-07-28 21:13:07.737839266 +0000 UTC m=+1692.572082852"
Jul 28 21:13:14.732570 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:14.732495    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:17.718659 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.718619    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:17.719619 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.719599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:17.771235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.771205    2572 generic.go:356] "Generic (PLEG): container finished" podID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerID="454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44" exitCode=0
Jul 28 21:13:17.771408 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.771278    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" event={"ID":"66a16f76-1d6f-412f-823f-87f40e16c77f","Type":"ContainerDied","Data":"454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44"}
Jul 28 21:13:17.771719 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.771699    2572 scope.go:117] "RemoveContainer" containerID="454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44"
Jul 28 21:13:17.774015 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.773969    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:17.774119 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.774081    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:17.774174 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:17.774138    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:18.783871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:18.783829    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" event={"ID":"66a16f76-1d6f-412f-823f-87f40e16c77f","Type":"ContainerStarted","Data":"c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95"}
Jul 28 21:13:19.227855 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:19.227771    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:19.229206 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:19.229180    2572 patch_prober.go:28] interesting pod/e2e-ait-b71fef06-openshift-default-5496664854-rglmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 28 21:13:19.229326 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:19.229232    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 28 21:13:19.692014 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:19.691960    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:20.228382 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:20.228336    2572 patch_prober.go:28] interesting pod/e2e-ait-b71fef06-openshift-default-5496664854-rglmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 28 21:13:20.228861 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:20.228401    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 28 21:13:21.227891 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:21.227849    2572 patch_prober.go:28] interesting pod/e2e-ait-b71fef06-openshift-default-5496664854-rglmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 28 21:13:21.228087 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:21.227914    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 28 21:13:22.227883 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:22.227848    2572 patch_prober.go:28] interesting pod/e2e-ait-b71fef06-openshift-default-5496664854-rglmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 28 21:13:22.228324 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:22.227905    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 28 21:13:23.232244 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:23.232213    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:23.233338 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:23.233320    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:45.865487 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:45.865449    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"]
Jul 28 21:13:45.866132 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:45.865671    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4" podUID="a808bcb2-c379-46dc-9bc8-36727b57d751" containerName="maas-api" containerID="cri-o://b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed" gracePeriod=30
Jul 28 21:13:45.879985 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:45.879953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:45.911483 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:45.911449    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"]
Jul 28 21:13:45.911688 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:45.911664    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6" podUID="83f4a5a5-8487-4208-83a9-44ea508808c2" containerName="payload-processing" containerID="cri-o://3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050" gracePeriod=30
Jul 28 21:13:45.917055 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:45.917025    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"]
Jul 28 21:13:45.917441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:45.917414    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h" podUID="1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" containerName="payload-pre-processing" containerID="cri-o://2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3" gracePeriod=30
Jul 28 21:13:46.184807 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.184751    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"]
Jul 28 21:13:46.185070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.185042    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy" containerID="cri-o://c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95" gracePeriod=30
Jul 28 21:13:46.213279 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.212725    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:46.217015 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.216989    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:46.258006 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.257983    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:46.352846 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.352812    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s6zs\" (UniqueName: \"kubernetes.io/projected/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-kube-api-access-4s6zs\") pod \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") "
Jul 28 21:13:46.353063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.352887    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a808bcb2-c379-46dc-9bc8-36727b57d751-openshift-service-ca\") pod \"a808bcb2-c379-46dc-9bc8-36727b57d751\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") "
Jul 28 21:13:46.353063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.352915    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-plugins-config-volume\") pod \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\" (UID: \"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7\") "
Jul 28 21:13:46.353063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.352935    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls\") pod \"a808bcb2-c379-46dc-9bc8-36727b57d751\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") "
Jul 28 21:13:46.353063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.352955    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nptzz\" (UniqueName: \"kubernetes.io/projected/83f4a5a5-8487-4208-83a9-44ea508808c2-kube-api-access-nptzz\") pod \"83f4a5a5-8487-4208-83a9-44ea508808c2\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") "
Jul 28 21:13:46.353063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.352979    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f4a5a5-8487-4208-83a9-44ea508808c2-plugins-config-volume\") pod \"83f4a5a5-8487-4208-83a9-44ea508808c2\" (UID: \"83f4a5a5-8487-4208-83a9-44ea508808c2\") "
Jul 28 21:13:46.353063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.353003    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4tvk\" (UniqueName: \"kubernetes.io/projected/a808bcb2-c379-46dc-9bc8-36727b57d751-kube-api-access-f4tvk\") pod \"a808bcb2-c379-46dc-9bc8-36727b57d751\" (UID: \"a808bcb2-c379-46dc-9bc8-36727b57d751\") "
Jul 28 21:13:46.353418 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.353380    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83f4a5a5-8487-4208-83a9-44ea508808c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83f4a5a5-8487-4208-83a9-44ea508808c2" (UID: "83f4a5a5-8487-4208-83a9-44ea508808c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:13:46.353488 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.353381    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a808bcb2-c379-46dc-9bc8-36727b57d751-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a808bcb2-c379-46dc-9bc8-36727b57d751" (UID: "a808bcb2-c379-46dc-9bc8-36727b57d751"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:13:46.353693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.353668    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" (UID: "1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:13:46.355415 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.355384    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a808bcb2-c379-46dc-9bc8-36727b57d751-kube-api-access-f4tvk" (OuterVolumeSpecName: "kube-api-access-f4tvk") pod "a808bcb2-c379-46dc-9bc8-36727b57d751" (UID: "a808bcb2-c379-46dc-9bc8-36727b57d751"). InnerVolumeSpecName "kube-api-access-f4tvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:13:46.355536 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.355427    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a808bcb2-c379-46dc-9bc8-36727b57d751" (UID: "a808bcb2-c379-46dc-9bc8-36727b57d751"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:13:46.355536 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.355441    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83f4a5a5-8487-4208-83a9-44ea508808c2-kube-api-access-nptzz" (OuterVolumeSpecName: "kube-api-access-nptzz") pod "83f4a5a5-8487-4208-83a9-44ea508808c2" (UID: "83f4a5a5-8487-4208-83a9-44ea508808c2"). InnerVolumeSpecName "kube-api-access-nptzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:13:46.355536 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.355484    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-kube-api-access-4s6zs" (OuterVolumeSpecName: "kube-api-access-4s6zs") pod "1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" (UID: "1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7"). InnerVolumeSpecName "kube-api-access-4s6zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:13:46.454274 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.454238    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:46.454274 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.454272    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a808bcb2-c379-46dc-9bc8-36727b57d751-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:46.454274 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.454284    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nptzz\" (UniqueName: \"kubernetes.io/projected/83f4a5a5-8487-4208-83a9-44ea508808c2-kube-api-access-nptzz\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:46.454522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.454293    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83f4a5a5-8487-4208-83a9-44ea508808c2-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:46.454522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.454302    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4tvk\" (UniqueName: \"kubernetes.io/projected/a808bcb2-c379-46dc-9bc8-36727b57d751-kube-api-access-f4tvk\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:46.454522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.454310    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s6zs\" (UniqueName: \"kubernetes.io/projected/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7-kube-api-access-4s6zs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:46.454522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.454318    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a808bcb2-c379-46dc-9bc8-36727b57d751-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:46.928731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.928689    2572 generic.go:356] "Generic (PLEG): container finished" podID="83f4a5a5-8487-4208-83a9-44ea508808c2" containerID="3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050" exitCode=0
Jul 28 21:13:46.929272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.928748    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"
Jul 28 21:13:46.929272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.928807    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6" event={"ID":"83f4a5a5-8487-4208-83a9-44ea508808c2","Type":"ContainerDied","Data":"3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050"}
Jul 28 21:13:46.929272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.928864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6" event={"ID":"83f4a5a5-8487-4208-83a9-44ea508808c2","Type":"ContainerDied","Data":"905053b801b05ada20913244899ae86e0adf78e84f166f82a7abd4b322169c02"}
Jul 28 21:13:46.929272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.928888    2572 scope.go:117] "RemoveContainer" containerID="3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050"
Jul 28 21:13:46.930272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.930089    2572 generic.go:356] "Generic (PLEG): container finished" podID="1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" containerID="2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3" exitCode=0
Jul 28 21:13:46.930272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.930172    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"
Jul 28 21:13:46.930272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.930169    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h" event={"ID":"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7","Type":"ContainerDied","Data":"2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3"}
Jul 28 21:13:46.930455 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.930302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h" event={"ID":"1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7","Type":"ContainerDied","Data":"a09feed3d1ae020f89e72d71bfeb58071e08862fab0810b94388de441b080532"}
Jul 28 21:13:46.931510 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.931487    2572 generic.go:356] "Generic (PLEG): container finished" podID="a808bcb2-c379-46dc-9bc8-36727b57d751" containerID="b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed" exitCode=0
Jul 28 21:13:46.931631 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.931535    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"
Jul 28 21:13:46.931685 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.931532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4" event={"ID":"a808bcb2-c379-46dc-9bc8-36727b57d751","Type":"ContainerDied","Data":"b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed"}
Jul 28 21:13:46.931732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.931703    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4" event={"ID":"a808bcb2-c379-46dc-9bc8-36727b57d751","Type":"ContainerDied","Data":"6ab4f6b5a2c67317d5182a833d0e4426a984369cbaa716d9e19f7bd51be4171d"}
Jul 28 21:13:46.940567 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.940547    2572 scope.go:117] "RemoveContainer" containerID="3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050"
Jul 28 21:13:46.940896 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:46.940870    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050\": container with ID starting with 3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050 not found: ID does not exist" containerID="3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050"
Jul 28 21:13:46.941056 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.940906    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050"} err="failed to get container status \"3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050\": rpc error: code = NotFound desc = could not find container \"3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050\": container with ID starting with 3d1af8efcc09cc536605f769e52bb0256868ec11d7de65a5505c6bde6046e050 not found: ID does not exist"
Jul 28 21:13:46.941056 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.940924    2572 scope.go:117] "RemoveContainer" containerID="2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3"
Jul 28 21:13:46.950230 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.950212    2572 scope.go:117] "RemoveContainer" containerID="2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3"
Jul 28 21:13:46.950548 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:46.950529    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3\": container with ID starting with 2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3 not found: ID does not exist" containerID="2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3"
Jul 28 21:13:46.950592 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.950556    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3"} err="failed to get container status \"2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3\": rpc error: code = NotFound desc = could not find container \"2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3\": container with ID starting with 2070fa84955061f25bbfa6f7ebba3188a4ce9e9f78bd2d443f2642c87f89fbf3 not found: ID does not exist"
Jul 28 21:13:46.950592 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.950574    2572 scope.go:117] "RemoveContainer" containerID="b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed"
Jul 28 21:13:46.952119 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.952098    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"]
Jul 28 21:13:46.959139 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.959121    2572 scope.go:117] "RemoveContainer" containerID="b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed"
Jul 28 21:13:46.959416 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:46.959398    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed\": container with ID starting with b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed not found: ID does not exist" containerID="b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed"
Jul 28 21:13:46.959457 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.959423    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed"} err="failed to get container status \"b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed\": rpc error: code = NotFound desc = could not find container \"b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed\": container with ID starting with b2e6e575031fcbdc4bf1345ec8aa7ab835e4dad7de4831466e6f510bef9a92ed not found: ID does not exist"
Jul 28 21:13:46.960012 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.959994    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6"]
Jul 28 21:13:46.969994 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.969971    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"]
Jul 28 21:13:46.978284 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.978258    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b71fef06-754d5df584-rk7g4"]
Jul 28 21:13:46.992540 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.992512    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"]
Jul 28 21:13:46.996915 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:46.996890    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h"]
Jul 28 21:13:47.315629 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.315541    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"]
Jul 28 21:13:47.316018 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316001    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" containerName="payload-pre-processing"
Jul 28 21:13:47.316128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316020    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" containerName="payload-pre-processing"
Jul 28 21:13:47.316128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316035    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f4a5a5-8487-4208-83a9-44ea508808c2" containerName="payload-processing"
Jul 28 21:13:47.316128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316043    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f4a5a5-8487-4208-83a9-44ea508808c2" containerName="payload-processing"
Jul 28 21:13:47.316128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316053    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a808bcb2-c379-46dc-9bc8-36727b57d751" containerName="maas-api"
Jul 28 21:13:47.316128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316061    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a808bcb2-c379-46dc-9bc8-36727b57d751" containerName="maas-api"
Jul 28 21:13:47.316368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316173    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" containerName="payload-pre-processing"
Jul 28 21:13:47.316368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316188    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a808bcb2-c379-46dc-9bc8-36727b57d751" containerName="maas-api"
Jul 28 21:13:47.316368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.316198    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="83f4a5a5-8487-4208-83a9-44ea508808c2" containerName="payload-processing"
Jul 28 21:13:47.320798 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.320758    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.323484 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.323466    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9fd4a294-gw-openshift-default-dockercfg-qtsls\""
Jul 28 21:13:47.333151 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.333130    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"]
Jul 28 21:13:47.463644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-envoy\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.463644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-credential-socket\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.463965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-socket\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.463965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-data\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.463965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463762    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-podinfo\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.463965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgn2w\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-kube-api-access-hgn2w\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.463965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-certs\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.463965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.463943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-token\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.464403 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.464052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istiod-ca-cert\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565033 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.564987    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-credential-socket\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565033 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-socket\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-data\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-podinfo\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565106    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgn2w\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-kube-api-access-hgn2w\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-certs\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-token\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565254    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istiod-ca-cert\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565578 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565338    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-envoy\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565578 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565483    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-credential-socket\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565578 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565488    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-socket\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565578 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565540    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-certs\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.565807 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.565720    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-data\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.566056 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.566039    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istiod-ca-cert\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.567716 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.567690    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-envoy\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.567965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.567945    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-podinfo\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.582614 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.582586    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-token\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.582768 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.582669    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgn2w\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-kube-api-access-hgn2w\") pod \"e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") " pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.632651 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.632605    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:47.641936 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.641910    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:47.717865 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.717832    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7" path="/var/lib/kubelet/pods/1daca6e1-2e9c-4d9f-840b-76dc2bc5a5b7/volumes"
Jul 28 21:13:47.718200 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.718187    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83f4a5a5-8487-4208-83a9-44ea508808c2" path="/var/lib/kubelet/pods/83f4a5a5-8487-4208-83a9-44ea508808c2/volumes"
Jul 28 21:13:47.718523 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.718510    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a808bcb2-c379-46dc-9bc8-36727b57d751" path="/var/lib/kubelet/pods/a808bcb2-c379-46dc-9bc8-36727b57d751/volumes"
Jul 28 21:13:47.778242 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.778208    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"]
Jul 28 21:13:47.784694 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:13:47.784657    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44bc94b_c6c2_4849_a572_bbd1b39cb4b6.slice/crio-824c2f59ecffe3e53926301c84fbd834a8070617d786300e4b13a0e64aa4df52 WatchSource:0}: Error finding container 824c2f59ecffe3e53926301c84fbd834a8070617d786300e4b13a0e64aa4df52: Status 404 returned error can't find the container with id 824c2f59ecffe3e53926301c84fbd834a8070617d786300e4b13a0e64aa4df52
Jul 28 21:13:47.786434 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.786404    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:47.786516 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.786473    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:47.786516 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.786502    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:13:47.941304 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.941263    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" event={"ID":"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6","Type":"ContainerStarted","Data":"b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4"}
Jul 28 21:13:47.941834 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.941322    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" event={"ID":"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6","Type":"ContainerStarted","Data":"824c2f59ecffe3e53926301c84fbd834a8070617d786300e4b13a0e64aa4df52"}
Jul 28 21:13:47.963809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:47.963722    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podStartSLOduration=0.96369802 podStartE2EDuration="963.69802ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:47.961930713 +0000 UTC m=+1732.796174299" watchObservedRunningTime="2026-07-28 21:13:47.96369802 +0000 UTC m=+1732.797941608"
Jul 28 21:13:48.633697 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:48.633655    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:48.638882 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:48.638856    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:48.947334 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:48.947247    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:48.948220 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:48.948203    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:13:49.447256 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.447226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:49.514698 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.514662    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"]
Jul 28 21:13:49.518286 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.518260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.520721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.520696    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9fd4a294-serving-cert\""
Jul 28 21:13:49.536331 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.531313    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"]
Jul 28 21:13:49.548504 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.548475    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:49.685909 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.685871    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.686098 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.685922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j66cd\" (UniqueName: \"kubernetes.io/projected/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-kube-api-access-j66cd\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.686098 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.685988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-openshift-service-ca\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.786676 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.786592    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j66cd\" (UniqueName: \"kubernetes.io/projected/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-kube-api-access-j66cd\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.786676 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.786631    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-openshift-service-ca\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.786962 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.786708    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.786962 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:49.786893    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-serving-cert: secret "maas-api-e2e-migrate-9fd4a294-serving-cert" not found
Jul 28 21:13:49.786962 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:49.786950    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls podName:78a16ff3-9f7c-44aa-b900-8eafb84ad6f5 nodeName:}" failed. No retries permitted until 2026-07-28 21:13:50.286934485 +0000 UTC m=+1735.121178049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls") pod "maas-api-e2e-migrate-9fd4a294-58454d9777-95md9" (UID: "78a16ff3-9f7c-44aa-b900-8eafb84ad6f5") : secret "maas-api-e2e-migrate-9fd4a294-serving-cert" not found
Jul 28 21:13:49.787408 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.787384    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-openshift-service-ca\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:49.797185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:49.797161    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j66cd\" (UniqueName: \"kubernetes.io/projected/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-kube-api-access-j66cd\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:50.006179 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.006143    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:50.106185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.106101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:50.151440 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.151401    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"]
Jul 28 21:13:50.155309 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.155294    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.157693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.157669    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-9fd4a294\""
Jul 28 21:13:50.157853 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.157740    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-9fd4a294-dockercfg-m2nhf\""
Jul 28 21:13:50.163618 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.163595    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"]
Jul 28 21:13:50.166743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.166718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:13:50.291315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.291280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:50.291499 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.291347    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhb97\" (UniqueName: \"kubernetes.io/projected/5bbddabf-8815-4219-a74a-5e94a01e4f01-kube-api-access-dhb97\") pod \"payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.291499 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.291398    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bbddabf-8815-4219-a74a-5e94a01e4f01-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.294016 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.293992    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls\") pod \"maas-api-e2e-migrate-9fd4a294-58454d9777-95md9\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:50.391893 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.391857    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhb97\" (UniqueName: \"kubernetes.io/projected/5bbddabf-8815-4219-a74a-5e94a01e4f01-kube-api-access-dhb97\") pod \"payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.392062 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.391930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bbddabf-8815-4219-a74a-5e94a01e4f01-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.392589 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.392570    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bbddabf-8815-4219-a74a-5e94a01e4f01-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.400934 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.400914    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhb97\" (UniqueName: \"kubernetes.io/projected/5bbddabf-8815-4219-a74a-5e94a01e4f01-kube-api-access-dhb97\") pod \"payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.434957 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.434908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:50.468233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.468204    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.611204 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.611045    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"]
Jul 28 21:13:50.614743 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:13:50.614711    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a16ff3_9f7c_44aa_b900_8eafb84ad6f5.slice/crio-08f16f63394bf4de7a954b26b8a565ee9f6178715e8131de1acd7bbacab0b84b WatchSource:0}: Error finding container 08f16f63394bf4de7a954b26b8a565ee9f6178715e8131de1acd7bbacab0b84b: Status 404 returned error can't find the container with id 08f16f63394bf4de7a954b26b8a565ee9f6178715e8131de1acd7bbacab0b84b
Jul 28 21:13:50.858888 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.858860    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"]
Jul 28 21:13:50.860756 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:13:50.860727    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbddabf_8815_4219_a74a_5e94a01e4f01.slice/crio-2f822cc3f0cbeaa5865161fb3cff0f7ffa2fc97a0ab303a1ec73996ae85fee3b WatchSource:0}: Error finding container 2f822cc3f0cbeaa5865161fb3cff0f7ffa2fc97a0ab303a1ec73996ae85fee3b: Status 404 returned error can't find the container with id 2f822cc3f0cbeaa5865161fb3cff0f7ffa2fc97a0ab303a1ec73996ae85fee3b
Jul 28 21:13:50.958087 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.958053    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp" event={"ID":"5bbddabf-8815-4219-a74a-5e94a01e4f01","Type":"ContainerStarted","Data":"4ff6c61352a6fdfd5f1e7635d25f1aec16a099299850a3190411e71aefa7543e"}
Jul 28 21:13:50.958387 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.958122    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp" event={"ID":"5bbddabf-8815-4219-a74a-5e94a01e4f01","Type":"ContainerStarted","Data":"2f822cc3f0cbeaa5865161fb3cff0f7ffa2fc97a0ab303a1ec73996ae85fee3b"}
Jul 28 21:13:50.958387 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.958247    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:13:50.959391 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.959369    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9" event={"ID":"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5","Type":"ContainerStarted","Data":"08f16f63394bf4de7a954b26b8a565ee9f6178715e8131de1acd7bbacab0b84b"}
Jul 28 21:13:50.974021 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:50.973959    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp" podStartSLOduration=0.973939169 podStartE2EDuration="973.939169ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:50.972690325 +0000 UTC m=+1735.806933913" watchObservedRunningTime="2026-07-28 21:13:50.973939169 +0000 UTC m=+1735.808182745"
Jul 28 21:13:51.434739 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.434715    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:51.605037 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.604933    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-credential-socket\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605037 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.604991    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a16f76-1d6f-412f-823f-87f40e16c77f-istiod-ca-cert\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605037 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605012    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-token\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605063    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6vvn\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-kube-api-access-k6vvn\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605170    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-podinfo\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605195    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-data\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605227    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-certs\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605258    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-envoy\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605244    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:13:51.605318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605289    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-socket\") pod \"66a16f76-1d6f-412f-823f-87f40e16c77f\" (UID: \"66a16f76-1d6f-412f-823f-87f40e16c77f\") "
Jul 28 21:13:51.605625 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605581    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.605677 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605631    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a16f76-1d6f-412f-823f-87f40e16c77f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:13:51.605733 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605672    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:13:51.605814 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.605769    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:13:51.606258 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.606233    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-data" (OuterVolumeSpecName: "istio-data") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:13:51.607506 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.607475    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-kube-api-access-k6vvn" (OuterVolumeSpecName: "kube-api-access-k6vvn") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "kube-api-access-k6vvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:13:51.607630 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.607521    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:13:51.607930 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.607908    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:13:51.608008 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.607971    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-token" (OuterVolumeSpecName: "istio-token") pod "66a16f76-1d6f-412f-823f-87f40e16c77f" (UID: "66a16f76-1d6f-412f-823f-87f40e16c77f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:13:51.706809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706735    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.706809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706767    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.706809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706814    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.707070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706826    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.707070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706837    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a16f76-1d6f-412f-823f-87f40e16c77f-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.707070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706847    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a16f76-1d6f-412f-823f-87f40e16c77f-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.707070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706862    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.707070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.706873    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6vvn\" (UniqueName: \"kubernetes.io/projected/66a16f76-1d6f-412f-823f-87f40e16c77f-kube-api-access-k6vvn\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:13:51.966666 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.966629    2572 generic.go:356] "Generic (PLEG): container finished" podID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerID="c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95" exitCode=0
Jul 28 21:13:51.966906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.966681    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"
Jul 28 21:13:51.966906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.966728    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" event={"ID":"66a16f76-1d6f-412f-823f-87f40e16c77f","Type":"ContainerDied","Data":"c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95"}
Jul 28 21:13:51.966906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.966812    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd" event={"ID":"66a16f76-1d6f-412f-823f-87f40e16c77f","Type":"ContainerDied","Data":"f85ecdcf61924d4e25603f075eab0566cfba36ac0a93b15e03df7d1360a161ea"}
Jul 28 21:13:51.966906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.966849    2572 scope.go:117] "RemoveContainer" containerID="c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95"
Jul 28 21:13:51.968435 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.968408    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9" event={"ID":"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5","Type":"ContainerStarted","Data":"f79fb3c5ba7b626569a8bbabe510f3a8eae28643b9b9fcf059abbe1918a0b90c"}
Jul 28 21:13:51.968537 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.968466    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:13:51.976331 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.976314    2572 scope.go:117] "RemoveContainer" containerID="454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44"
Jul 28 21:13:51.985112 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.985089    2572 scope.go:117] "RemoveContainer" containerID="c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95"
Jul 28 21:13:51.985389 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:51.985366    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95\": container with ID starting with c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95 not found: ID does not exist" containerID="c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95"
Jul 28 21:13:51.985487 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.985395    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95"} err="failed to get container status \"c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95\": rpc error: code = NotFound desc = could not find container \"c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95\": container with ID starting with c7a1b8aa3bedeebf5724d384e1a230ee8977a68ed134ab75d2b229eb201e8b95 not found: ID does not exist"
Jul 28 21:13:51.985487 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.985412    2572 scope.go:117] "RemoveContainer" containerID="454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44"
Jul 28 21:13:51.985668 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:13:51.985650    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44\": container with ID starting with 454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44 not found: ID does not exist" containerID="454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44"
Jul 28 21:13:51.985709 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.985676    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44"} err="failed to get container status \"454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44\": rpc error: code = NotFound desc = could not find container \"454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44\": container with ID starting with 454d1281de4b2edf1a75faa31c13b0dd1c9c0bc780e566ab14e8ac9abd860f44 not found: ID does not exist"
Jul 28 21:13:51.986771 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.986752    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"]
Jul 28 21:13:51.990272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:51.990252    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd"]
Jul 28 21:13:52.006442 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:52.006389    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9" podStartSLOduration=2.678338219 podStartE2EDuration="3.006370735s" totalImagesPullingTime="328.032516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:52.004014017 +0000 UTC m=+1736.838257604" watchObservedRunningTime="2026-07-28 21:13:52.006370735 +0000 UTC m=+1736.840614322"
Jul 28 21:13:53.718295 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:53.718259    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" path="/var/lib/kubelet/pods/66a16f76-1d6f-412f-823f-87f40e16c77f/volumes"
Jul 28 21:13:57.988284 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:13:57.988232    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:14:01.970989 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:01.970954    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:14:03.948771 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:03.948738    2572 patch_prober.go:28] interesting pod/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:14:03.949203 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:03.948820    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 21:14:04.036706 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:04.036674    2572 generic.go:356] "Generic (PLEG): container finished" podID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerID="b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4" exitCode=0
Jul 28 21:14:04.036896 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:04.036750    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" event={"ID":"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6","Type":"ContainerDied","Data":"b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4"}
Jul 28 21:14:04.037179 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:04.037165    2572 scope.go:117] "RemoveContainer" containerID="b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4"
Jul 28 21:14:04.038203 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:04.038173    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:04.038279 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:04.038261    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:04.038321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:04.038306    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:05.045333 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:05.045296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" event={"ID":"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6","Type":"ContainerStarted","Data":"2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d"}
Jul 28 21:14:05.633363 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:05.633315    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:14:05.633627 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:05.633606    2572 patch_prober.go:28] interesting pod/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:14:05.633675 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:05.633657    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 21:14:06.633855 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:06.633819    2572 patch_prober.go:28] interesting pod/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:14:06.634268 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:06.633879    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 21:14:07.633944 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:07.633903    2572 patch_prober.go:28] interesting pod/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:14:07.634369 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:07.633963    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 21:14:08.633606 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:08.633565    2572 patch_prober.go:28] interesting pod/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:14:08.633841 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:08.633627    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 21:14:09.637845 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:09.637813    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:14:09.638263 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:09.638078    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:14:09.639104 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:09.639086    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:14:20.831385 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:20.831348    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"]
Jul 28 21:14:20.832339 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:20.832307    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9" podUID="78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" containerName="maas-api" containerID="cri-o://f79fb3c5ba7b626569a8bbabe510f3a8eae28643b9b9fcf059abbe1918a0b90c" gracePeriod=30
Jul 28 21:14:20.853010 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:20.852981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:20.891294 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:20.891254    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"]
Jul 28 21:14:20.892228 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:20.892188    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp" podUID="5bbddabf-8815-4219-a74a-5e94a01e4f01" containerName="payload-pre-processing" containerID="cri-o://4ff6c61352a6fdfd5f1e7635d25f1aec16a099299850a3190411e71aefa7543e" gracePeriod=30
Jul 28 21:14:20.913699 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:20.913640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:21.014142 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.014115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:21.115077 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.115042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:21.127532 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.127497    2572 generic.go:356] "Generic (PLEG): container finished" podID="78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" containerID="f79fb3c5ba7b626569a8bbabe510f3a8eae28643b9b9fcf059abbe1918a0b90c" exitCode=0
Jul 28 21:14:21.127686 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.127576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9" event={"ID":"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5","Type":"ContainerDied","Data":"f79fb3c5ba7b626569a8bbabe510f3a8eae28643b9b9fcf059abbe1918a0b90c"}
Jul 28 21:14:21.129513 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.129443    2572 generic.go:356] "Generic (PLEG): container finished" podID="5bbddabf-8815-4219-a74a-5e94a01e4f01" containerID="4ff6c61352a6fdfd5f1e7635d25f1aec16a099299850a3190411e71aefa7543e" exitCode=0
Jul 28 21:14:21.129513 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.129506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp" event={"ID":"5bbddabf-8815-4219-a74a-5e94a01e4f01","Type":"ContainerDied","Data":"4ff6c61352a6fdfd5f1e7635d25f1aec16a099299850a3190411e71aefa7543e"}
Jul 28 21:14:21.165731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.165700    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:14:21.172346 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.172303    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"]
Jul 28 21:14:21.177816 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.172748    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy" containerID="cri-o://2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d" gracePeriod=30
Jul 28 21:14:21.189748 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.189675    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:21.207550 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.207522    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:14:21.310297 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310254    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhb97\" (UniqueName: \"kubernetes.io/projected/5bbddabf-8815-4219-a74a-5e94a01e4f01-kube-api-access-dhb97\") pod \"5bbddabf-8815-4219-a74a-5e94a01e4f01\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") "
Jul 28 21:14:21.310479 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310322    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-openshift-service-ca\") pod \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") "
Jul 28 21:14:21.310479 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310432    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls\") pod \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") "
Jul 28 21:14:21.310595 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310503    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j66cd\" (UniqueName: \"kubernetes.io/projected/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-kube-api-access-j66cd\") pod \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\" (UID: \"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5\") "
Jul 28 21:14:21.310595 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310529    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bbddabf-8815-4219-a74a-5e94a01e4f01-plugins-config-volume\") pod \"5bbddabf-8815-4219-a74a-5e94a01e4f01\" (UID: \"5bbddabf-8815-4219-a74a-5e94a01e4f01\") "
Jul 28 21:14:21.310728 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310705    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" (UID: "78a16ff3-9f7c-44aa-b900-8eafb84ad6f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:14:21.310909 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310887    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:21.310984 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.310944    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bbddabf-8815-4219-a74a-5e94a01e4f01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5bbddabf-8815-4219-a74a-5e94a01e4f01" (UID: "5bbddabf-8815-4219-a74a-5e94a01e4f01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:14:21.312746 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.312719    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-kube-api-access-j66cd" (OuterVolumeSpecName: "kube-api-access-j66cd") pod "78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" (UID: "78a16ff3-9f7c-44aa-b900-8eafb84ad6f5"). InnerVolumeSpecName "kube-api-access-j66cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:21.313210 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.313192    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" (UID: "78a16ff3-9f7c-44aa-b900-8eafb84ad6f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:14:21.313263 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.313206    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bbddabf-8815-4219-a74a-5e94a01e4f01-kube-api-access-dhb97" (OuterVolumeSpecName: "kube-api-access-dhb97") pod "5bbddabf-8815-4219-a74a-5e94a01e4f01" (UID: "5bbddabf-8815-4219-a74a-5e94a01e4f01"). InnerVolumeSpecName "kube-api-access-dhb97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:21.412149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.412105    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhb97\" (UniqueName: \"kubernetes.io/projected/5bbddabf-8815-4219-a74a-5e94a01e4f01-kube-api-access-dhb97\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:21.412149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.412139    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:21.412149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.412148    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j66cd\" (UniqueName: \"kubernetes.io/projected/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5-kube-api-access-j66cd\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:21.412149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.412157    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bbddabf-8815-4219-a74a-5e94a01e4f01-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:21.861341 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.861298    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:21.961742 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:21.961705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:22.009372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009291    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"]
Jul 28 21:14:22.009695 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009682    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" containerName="maas-api"
Jul 28 21:14:22.009743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009698    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" containerName="maas-api"
Jul 28 21:14:22.009743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009717    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy"
Jul 28 21:14:22.009743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009722    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy"
Jul 28 21:14:22.009743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009730    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy"
Jul 28 21:14:22.009743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009737    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy"
Jul 28 21:14:22.009743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009744    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbddabf-8815-4219-a74a-5e94a01e4f01" containerName="payload-pre-processing"
Jul 28 21:14:22.009968 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009749    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbddabf-8815-4219-a74a-5e94a01e4f01" containerName="payload-pre-processing"
Jul 28 21:14:22.009968 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009827    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" containerName="maas-api"
Jul 28 21:14:22.009968 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009836    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy"
Jul 28 21:14:22.009968 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.009841    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbddabf-8815-4219-a74a-5e94a01e4f01" containerName="payload-pre-processing"
Jul 28 21:14:22.013385 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.013364    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.015940 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.015919    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3c452994-openshift-default-dockercfg-l29sb\""
Jul 28 21:14:22.023590 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.023563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"]
Jul 28 21:14:22.047443 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.047398    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:22.118632 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118595    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-podinfo\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.118860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118653    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-envoy\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.118860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118693    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-data\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.118860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118720    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrnl7\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-kube-api-access-qrnl7\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.118860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-credential-socket\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.118860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093c4f5-6878-4478-8d8c-c7993681abdb-istiod-ca-cert\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.119183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-socket\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.119183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.118948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-token\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.119183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.119010    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-certs\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.136856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.136813    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9" event={"ID":"78a16ff3-9f7c-44aa-b900-8eafb84ad6f5","Type":"ContainerDied","Data":"08f16f63394bf4de7a954b26b8a565ee9f6178715e8131de1acd7bbacab0b84b"}
Jul 28 21:14:22.136856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.136834    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"
Jul 28 21:14:22.137109 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.136887    2572 scope.go:117] "RemoveContainer" containerID="f79fb3c5ba7b626569a8bbabe510f3a8eae28643b9b9fcf059abbe1918a0b90c"
Jul 28 21:14:22.138420 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.138383    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"
Jul 28 21:14:22.138420 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.138396    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp" event={"ID":"5bbddabf-8815-4219-a74a-5e94a01e4f01","Type":"ContainerDied","Data":"2f822cc3f0cbeaa5865161fb3cff0f7ffa2fc97a0ab303a1ec73996ae85fee3b"}
Jul 28 21:14:22.146760 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.146740    2572 scope.go:117] "RemoveContainer" containerID="4ff6c61352a6fdfd5f1e7635d25f1aec16a099299850a3190411e71aefa7543e"
Jul 28 21:14:22.156376 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.156243    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"]
Jul 28 21:14:22.163419 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.163393    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp"]
Jul 28 21:14:22.173222 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.173187    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"]
Jul 28 21:14:22.178372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.178335    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9fd4a294-58454d9777-95md9"]
Jul 28 21:14:22.219824 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.219762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-certs\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.219869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-podinfo\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.219905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-envoy\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.219935    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-data\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.219958    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrnl7\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-kube-api-access-qrnl7\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.219985    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-credential-socket\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093c4f5-6878-4478-8d8c-c7993681abdb-istiod-ca-cert\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-socket\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-token\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220222    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-certs\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220516 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220431    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-credential-socket\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220516 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-socket\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220619 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220563    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-data\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.220873 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.220709    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093c4f5-6878-4478-8d8c-c7993681abdb-istiod-ca-cert\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.222462 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.222439    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-envoy\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.222648 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.222630    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-podinfo\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.228190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.228162    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-token\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.228429 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.228406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrnl7\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-kube-api-access-qrnl7\") pod \"e2e-ait-3c452994-openshift-default-5c8c875586-l7r72\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") " pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.325758 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.325653    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:22.425963 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.425926    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:22.476964 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.476936    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"]
Jul 28 21:14:22.478957 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:14:22.478926    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1093c4f5_6878_4478_8d8c_c7993681abdb.slice/crio-7b9478cfb06eac54c95369bd1bf839854bc0f7170040b65cc8cf23ebeaad7dd8 WatchSource:0}: Error finding container 7b9478cfb06eac54c95369bd1bf839854bc0f7170040b65cc8cf23ebeaad7dd8: Status 404 returned error can't find the container with id 7b9478cfb06eac54c95369bd1bf839854bc0f7170040b65cc8cf23ebeaad7dd8
Jul 28 21:14:22.481218 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.481184    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:22.481308 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.481254    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:22.481308 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:22.481283    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:23.146444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.146408    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" event={"ID":"1093c4f5-6878-4478-8d8c-c7993681abdb","Type":"ContainerStarted","Data":"68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43"}
Jul 28 21:14:23.147005 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.146476    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" event={"ID":"1093c4f5-6878-4478-8d8c-c7993681abdb","Type":"ContainerStarted","Data":"7b9478cfb06eac54c95369bd1bf839854bc0f7170040b65cc8cf23ebeaad7dd8"}
Jul 28 21:14:23.165182 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.165120    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podStartSLOduration=2.165101654 podStartE2EDuration="2.165101654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:14:23.164073115 +0000 UTC m=+1767.998316702" watchObservedRunningTime="2026-07-28 21:14:23.165101654 +0000 UTC m=+1767.999345240"
Jul 28 21:14:23.325872 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.325829    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:23.327376 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.327353    2572 patch_prober.go:28] interesting pod/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 21:14:23.327455 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.327402    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 21:14:23.717870 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.717831    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bbddabf-8815-4219-a74a-5e94a01e4f01" path="/var/lib/kubelet/pods/5bbddabf-8815-4219-a74a-5e94a01e4f01/volumes"
Jul 28 21:14:23.718231 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:23.718218    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78a16ff3-9f7c-44aa-b900-8eafb84ad6f5" path="/var/lib/kubelet/pods/78a16ff3-9f7c-44aa-b900-8eafb84ad6f5/volumes"
Jul 28 21:14:24.331182 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.331150    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:24.510353 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.510313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:24.612932 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.612848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:24.641203 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.641159    2572 patch_prober.go:28] interesting pod/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:14:24.641365 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.641229    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:14:24.744814 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.742827    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"]
Jul 28 21:14:24.744814 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.743987    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a16f76-1d6f-412f-823f-87f40e16c77f" containerName="istio-proxy"
Jul 28 21:14:24.750084 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.749944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.752924 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.752893    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3c452994-serving-cert\""
Jul 28 21:14:24.753377 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.753348    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"]
Jul 28 21:14:24.777203 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.777168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:24.849972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.849937    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf21c8a-9c83-4520-8594-d45cb80d0fd3-openshift-service-ca\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.850159 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.849994    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vsbq\" (UniqueName: \"kubernetes.io/projected/acf21c8a-9c83-4520-8594-d45cb80d0fd3-kube-api-access-4vsbq\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.850159 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.850104    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf21c8a-9c83-4520-8594-d45cb80d0fd3-maas-api-tls\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.868544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.868468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:24.951451 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.951415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf21c8a-9c83-4520-8594-d45cb80d0fd3-openshift-service-ca\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.951660 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.951480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vsbq\" (UniqueName: \"kubernetes.io/projected/acf21c8a-9c83-4520-8594-d45cb80d0fd3-kube-api-access-4vsbq\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.951660 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.951554    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf21c8a-9c83-4520-8594-d45cb80d0fd3-maas-api-tls\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.952069 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.952053    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf21c8a-9c83-4520-8594-d45cb80d0fd3-openshift-service-ca\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.954291 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.954266    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf21c8a-9c83-4520-8594-d45cb80d0fd3-maas-api-tls\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:24.959681 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:24.959644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vsbq\" (UniqueName: \"kubernetes.io/projected/acf21c8a-9c83-4520-8594-d45cb80d0fd3-kube-api-access-4vsbq\") pod \"maas-api-e2e-ait-3c452994-66f69747bd-g6sw8\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:25.064061 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.064022    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:25.159485 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.159420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:25.160880 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.160840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:25.219742 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.219708    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"]
Jul 28 21:14:25.223523 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:14:25.223479    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf21c8a_9c83_4520_8594_d45cb80d0fd3.slice/crio-0e8a23d9715f91b7fcc24650340c56f56e8c6fc4d6c076a84b5364724faee20b WatchSource:0}: Error finding container 0e8a23d9715f91b7fcc24650340c56f56e8c6fc4d6c076a84b5364724faee20b: Status 404 returned error can't find the container with id 0e8a23d9715f91b7fcc24650340c56f56e8c6fc4d6c076a84b5364724faee20b
Jul 28 21:14:25.255418 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.255383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:25.355373 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.355338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:25.361912 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.361878    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"]
Jul 28 21:14:25.367521 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.367501    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.370502 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.370466    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3c452994-dockercfg-bjj5w\""
Jul 28 21:14:25.372017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.371640    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3c452994\""
Jul 28 21:14:25.375285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.375168    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"]
Jul 28 21:14:25.456388 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.456295    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec4fa64b-a131-41cc-8c70-0f096b939303-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.456388 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.456358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hd9x\" (UniqueName: \"kubernetes.io/projected/ec4fa64b-a131-41cc-8c70-0f096b939303-kube-api-access-7hd9x\") pod \"payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.557209 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.557167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hd9x\" (UniqueName: \"kubernetes.io/projected/ec4fa64b-a131-41cc-8c70-0f096b939303-kube-api-access-7hd9x\") pod \"payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.557433 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.557272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec4fa64b-a131-41cc-8c70-0f096b939303-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.558202 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.558182    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec4fa64b-a131-41cc-8c70-0f096b939303-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.565900 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.565872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hd9x\" (UniqueName: \"kubernetes.io/projected/ec4fa64b-a131-41cc-8c70-0f096b939303-kube-api-access-7hd9x\") pod \"payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.682949 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.682923    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:25.831131 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:25.831096    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"]
Jul 28 21:14:25.834986 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:14:25.834942    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4fa64b_a131_41cc_8c70_0f096b939303.slice/crio-34599f17ce99d4ece0f8eed7e15f36d7e64f59db11bea30795840ef54f275dca WatchSource:0}: Error finding container 34599f17ce99d4ece0f8eed7e15f36d7e64f59db11bea30795840ef54f275dca: Status 404 returned error can't find the container with id 34599f17ce99d4ece0f8eed7e15f36d7e64f59db11bea30795840ef54f275dca
Jul 28 21:14:26.165571 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.165533    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js" event={"ID":"ec4fa64b-a131-41cc-8c70-0f096b939303","Type":"ContainerStarted","Data":"ded1770da02e2dc2094aba2a0be528b5388b1f0c4bfcb4d6486a45da9c292e74"}
Jul 28 21:14:26.165822 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.165585    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js" event={"ID":"ec4fa64b-a131-41cc-8c70-0f096b939303","Type":"ContainerStarted","Data":"34599f17ce99d4ece0f8eed7e15f36d7e64f59db11bea30795840ef54f275dca"}
Jul 28 21:14:26.165822 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.165668    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:26.167049 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.167023    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8" event={"ID":"acf21c8a-9c83-4520-8594-d45cb80d0fd3","Type":"ContainerStarted","Data":"5e9263473a6e607a973b5a558d475cba5c84e1c6d9a96d96410abbfa90131e9d"}
Jul 28 21:14:26.167156 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.167069    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8" event={"ID":"acf21c8a-9c83-4520-8594-d45cb80d0fd3","Type":"ContainerStarted","Data":"0e8a23d9715f91b7fcc24650340c56f56e8c6fc4d6c076a84b5364724faee20b"}
Jul 28 21:14:26.183322 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.183255    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js" podStartSLOduration=1.183234206 podStartE2EDuration="1.183234206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:14:26.180037903 +0000 UTC m=+1771.014281490" watchObservedRunningTime="2026-07-28 21:14:26.183234206 +0000 UTC m=+1771.017477794"
Jul 28 21:14:26.198013 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.197961    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8" podStartSLOduration=1.787651496 podStartE2EDuration="2.197946192s" totalImagesPullingTime="410.294696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:14:26.19684002 +0000 UTC m=+1771.031083607" watchObservedRunningTime="2026-07-28 21:14:26.197946192 +0000 UTC m=+1771.032189779"
Jul 28 21:14:26.456856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.456831    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:14:26.566984 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.566950    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istiod-ca-cert\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567001    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-token\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567044    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-data\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567127    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-credential-socket\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567152    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-certs\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567188    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-envoy\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567468 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567219    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-podinfo\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567468 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567251    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-socket\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567468 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567311    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgn2w\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-kube-api-access-hgn2w\") pod \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\" (UID: \"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6\") "
Jul 28 21:14:26.567468 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567361    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:14:26.567669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567491    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:26.567669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567596    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:26.567927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567701    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.567927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567720    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.567927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567735    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.567927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.567925    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:26.568167 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.568054    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:26.569491 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.569459    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:26.569610 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.569556    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:14:26.569711 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.569693    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:26.569856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.569838    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-kube-api-access-hgn2w" (OuterVolumeSpecName: "kube-api-access-hgn2w") pod "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" (UID: "e44bc94b-c6c2-4849-a572-bbd1b39cb4b6"). InnerVolumeSpecName "kube-api-access-hgn2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:26.668702 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.668661    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.668702 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.668694    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.668702 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.668703    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.668702 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.668713    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgn2w\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-kube-api-access-hgn2w\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.669019 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.668723    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:26.669019 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:26.668732    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:27.173850 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.173811    2572 generic.go:356] "Generic (PLEG): container finished" podID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerID="2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d" exitCode=0
Jul 28 21:14:27.174044 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.173886    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"
Jul 28 21:14:27.174044 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.173903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" event={"ID":"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6","Type":"ContainerDied","Data":"2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d"}
Jul 28 21:14:27.174044 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.173967    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k" event={"ID":"e44bc94b-c6c2-4849-a572-bbd1b39cb4b6","Type":"ContainerDied","Data":"824c2f59ecffe3e53926301c84fbd834a8070617d786300e4b13a0e64aa4df52"}
Jul 28 21:14:27.174044 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.173996    2572 scope.go:117] "RemoveContainer" containerID="2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d"
Jul 28 21:14:27.174663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.174566    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:27.185650 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.185631    2572 scope.go:117] "RemoveContainer" containerID="b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4"
Jul 28 21:14:27.195433 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.195405    2572 scope.go:117] "RemoveContainer" containerID="2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d"
Jul 28 21:14:27.195828 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:14:27.195759    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d\": container with ID starting with 2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d not found: ID does not exist" containerID="2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d"
Jul 28 21:14:27.195930 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.195817    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d"} err="failed to get container status \"2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d\": rpc error: code = NotFound desc = could not find container \"2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d\": container with ID starting with 2be7f66b8e1fd9c091137bde9a6038832f02a6f8c6182e86f7bc9d305364327d not found: ID does not exist"
Jul 28 21:14:27.195930 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.195846    2572 scope.go:117] "RemoveContainer" containerID="b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4"
Jul 28 21:14:27.196186 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:14:27.196168    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4\": container with ID starting with b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4 not found: ID does not exist" containerID="b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4"
Jul 28 21:14:27.196234 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.196194    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4"} err="failed to get container status \"b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4\": rpc error: code = NotFound desc = could not find container \"b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4\": container with ID starting with b5975d36e3051392ff236e1a4f3b0c5e5833a18d7077a82617cb7c8cab9656e4 not found: ID does not exist"
Jul 28 21:14:27.196234 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.196224    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"]
Jul 28 21:14:27.201972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.201951    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k"]
Jul 28 21:14:27.717705 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:27.717668    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" path="/var/lib/kubelet/pods/e44bc94b-c6c2-4849-a572-bbd1b39cb4b6/volumes"
Jul 28 21:14:33.198383 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:33.198345    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:37.177383 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:37.177351    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:39.251700 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:39.251670    2572 generic.go:356] "Generic (PLEG): container finished" podID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerID="68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43" exitCode=0
Jul 28 21:14:39.252179 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:39.251733    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" event={"ID":"1093c4f5-6878-4478-8d8c-c7993681abdb","Type":"ContainerDied","Data":"68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43"}
Jul 28 21:14:39.252225 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:39.252180    2572 scope.go:117] "RemoveContainer" containerID="68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43"
Jul 28 21:14:39.253302 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:39.253272    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:39.253378 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:39.253360    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:39.253429 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:39.253413    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:40.159359 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:40.159312    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:40.258594 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:40.258561    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" event={"ID":"1093c4f5-6878-4478-8d8c-c7993681abdb","Type":"ContainerStarted","Data":"fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0"}
Jul 28 21:14:40.326805 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:40.326743    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:40.327892 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:40.327864    2572 patch_prober.go:28] interesting pod/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 21:14:40.328029 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:40.327924    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 21:14:41.326555 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:41.326516    2572 patch_prober.go:28] interesting pod/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 21:14:41.326956 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:41.326573    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 21:14:42.327132 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:42.327092    2572 patch_prober.go:28] interesting pod/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 21:14:42.327530 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:42.327161    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 21:14:43.327012 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:43.326977    2572 patch_prober.go:28] interesting pod/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 21:14:43.327212 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:43.327034    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 21:14:44.326216 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:44.326174    2572 patch_prober.go:28] interesting pod/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 21:14:44.326409 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:44.326234    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 21:14:45.330815 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:45.330763    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:45.331223 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:45.331054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:45.331805 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:45.331773    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:14:55.142415 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.142375    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"]
Jul 28 21:14:55.142936 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.142679    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8" podUID="acf21c8a-9c83-4520-8594-d45cb80d0fd3" containerName="maas-api" containerID="cri-o://5e9263473a6e607a973b5a558d475cba5c84e1c6d9a96d96410abbfa90131e9d" gracePeriod=30
Jul 28 21:14:55.171818 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.171763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:55.212244 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.212210    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"]
Jul 28 21:14:55.212471 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.212447    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js" podUID="ec4fa64b-a131-41cc-8c70-0f096b939303" containerName="payload-pre-processing" containerID="cri-o://ded1770da02e2dc2094aba2a0be528b5388b1f0c4bfcb4d6486a45da9c292e74" gracePeriod=30
Jul 28 21:14:55.273261 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.273230    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:55.338809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.338736    2572 generic.go:356] "Generic (PLEG): container finished" podID="ec4fa64b-a131-41cc-8c70-0f096b939303" containerID="ded1770da02e2dc2094aba2a0be528b5388b1f0c4bfcb4d6486a45da9c292e74" exitCode=0
Jul 28 21:14:55.338994 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.338818    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js" event={"ID":"ec4fa64b-a131-41cc-8c70-0f096b939303","Type":"ContainerDied","Data":"ded1770da02e2dc2094aba2a0be528b5388b1f0c4bfcb4d6486a45da9c292e74"}
Jul 28 21:14:55.340670 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.340645    2572 generic.go:356] "Generic (PLEG): container finished" podID="acf21c8a-9c83-4520-8594-d45cb80d0fd3" containerID="5e9263473a6e607a973b5a558d475cba5c84e1c6d9a96d96410abbfa90131e9d" exitCode=0
Jul 28 21:14:55.340828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.340709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8" event={"ID":"acf21c8a-9c83-4520-8594-d45cb80d0fd3","Type":"ContainerDied","Data":"5e9263473a6e607a973b5a558d475cba5c84e1c6d9a96d96410abbfa90131e9d"}
Jul 28 21:14:55.370354 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.370304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:55.429229 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.429101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:55.495870 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.495844    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:55.509988 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.509963    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:55.533680 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.533647    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vsbq\" (UniqueName: \"kubernetes.io/projected/acf21c8a-9c83-4520-8594-d45cb80d0fd3-kube-api-access-4vsbq\") pod \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") "
Jul 28 21:14:55.533874 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.533714    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf21c8a-9c83-4520-8594-d45cb80d0fd3-maas-api-tls\") pod \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") "
Jul 28 21:14:55.533874 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.533820    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf21c8a-9c83-4520-8594-d45cb80d0fd3-openshift-service-ca\") pod \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\" (UID: \"acf21c8a-9c83-4520-8594-d45cb80d0fd3\") "
Jul 28 21:14:55.534266 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.534234    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf21c8a-9c83-4520-8594-d45cb80d0fd3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "acf21c8a-9c83-4520-8594-d45cb80d0fd3" (UID: "acf21c8a-9c83-4520-8594-d45cb80d0fd3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:14:55.536042 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.536017    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf21c8a-9c83-4520-8594-d45cb80d0fd3-kube-api-access-4vsbq" (OuterVolumeSpecName: "kube-api-access-4vsbq") pod "acf21c8a-9c83-4520-8594-d45cb80d0fd3" (UID: "acf21c8a-9c83-4520-8594-d45cb80d0fd3"). InnerVolumeSpecName "kube-api-access-4vsbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:55.536042 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.536033    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf21c8a-9c83-4520-8594-d45cb80d0fd3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "acf21c8a-9c83-4520-8594-d45cb80d0fd3" (UID: "acf21c8a-9c83-4520-8594-d45cb80d0fd3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:14:55.634484 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.634449    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hd9x\" (UniqueName: \"kubernetes.io/projected/ec4fa64b-a131-41cc-8c70-0f096b939303-kube-api-access-7hd9x\") pod \"ec4fa64b-a131-41cc-8c70-0f096b939303\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") "
Jul 28 21:14:55.634658 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.634625    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec4fa64b-a131-41cc-8c70-0f096b939303-plugins-config-volume\") pod \"ec4fa64b-a131-41cc-8c70-0f096b939303\" (UID: \"ec4fa64b-a131-41cc-8c70-0f096b939303\") "
Jul 28 21:14:55.634897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.634881    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf21c8a-9c83-4520-8594-d45cb80d0fd3-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:55.634952 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.634904    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf21c8a-9c83-4520-8594-d45cb80d0fd3-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:55.634952 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.634919    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vsbq\" (UniqueName: \"kubernetes.io/projected/acf21c8a-9c83-4520-8594-d45cb80d0fd3-kube-api-access-4vsbq\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:55.635020 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.634946    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec4fa64b-a131-41cc-8c70-0f096b939303-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec4fa64b-a131-41cc-8c70-0f096b939303" (UID: "ec4fa64b-a131-41cc-8c70-0f096b939303"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:14:55.636771 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.636751    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4fa64b-a131-41cc-8c70-0f096b939303-kube-api-access-7hd9x" (OuterVolumeSpecName: "kube-api-access-7hd9x") pod "ec4fa64b-a131-41cc-8c70-0f096b939303" (UID: "ec4fa64b-a131-41cc-8c70-0f096b939303"). InnerVolumeSpecName "kube-api-access-7hd9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:55.735826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.735773    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec4fa64b-a131-41cc-8c70-0f096b939303-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:55.735826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.735827    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hd9x\" (UniqueName: \"kubernetes.io/projected/ec4fa64b-a131-41cc-8c70-0f096b939303-kube-api-access-7hd9x\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:14:55.754577 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.754549    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:14:55.763988 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:55.763958    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:14:56.346623 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.346591    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"
Jul 28 21:14:56.347206 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.346591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js" event={"ID":"ec4fa64b-a131-41cc-8c70-0f096b939303","Type":"ContainerDied","Data":"34599f17ce99d4ece0f8eed7e15f36d7e64f59db11bea30795840ef54f275dca"}
Jul 28 21:14:56.347206 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.346746    2572 scope.go:117] "RemoveContainer" containerID="ded1770da02e2dc2094aba2a0be528b5388b1f0c4bfcb4d6486a45da9c292e74"
Jul 28 21:14:56.348069 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.348051    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"
Jul 28 21:14:56.348145 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.348098    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8" event={"ID":"acf21c8a-9c83-4520-8594-d45cb80d0fd3","Type":"ContainerDied","Data":"0e8a23d9715f91b7fcc24650340c56f56e8c6fc4d6c076a84b5364724faee20b"}
Jul 28 21:14:56.356690 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.356667    2572 scope.go:117] "RemoveContainer" containerID="5e9263473a6e607a973b5a558d475cba5c84e1c6d9a96d96410abbfa90131e9d"
Jul 28 21:14:56.366834 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.366765    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"]
Jul 28 21:14:56.372830 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.372804    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3c452994-66f69747bd-g6sw8"]
Jul 28 21:14:56.382154 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.382116    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"]
Jul 28 21:14:56.389884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.389854    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js"]
Jul 28 21:14:56.576378 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.576274    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"]
Jul 28 21:14:56.576557 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.576525    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" containerID="cri-o://fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0" gracePeriod=30
Jul 28 21:14:56.600437 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.600397    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:56.842434 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:56.842315    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:57.088237 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.088175    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:57.380043 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380005    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"]
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380401    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380413    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380422    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4fa64b-a131-41cc-8c70-0f096b939303" containerName="payload-pre-processing"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380427    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4fa64b-a131-41cc-8c70-0f096b939303" containerName="payload-pre-processing"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380442    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf21c8a-9c83-4520-8594-d45cb80d0fd3" containerName="maas-api"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380448    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf21c8a-9c83-4520-8594-d45cb80d0fd3" containerName="maas-api"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380519    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380527    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf21c8a-9c83-4520-8594-d45cb80d0fd3" containerName="maas-api"
Jul 28 21:14:57.380544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.380533    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec4fa64b-a131-41cc-8c70-0f096b939303" containerName="payload-pre-processing"
Jul 28 21:14:57.385033 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.385011    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.387418 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.387397    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-42733177-openshift-default-dockercfg-b6tqb\""
Jul 28 21:14:57.396999 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.396973    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"]
Jul 28 21:14:57.400278 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.400255    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:57.455793 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.455749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w54j\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-kube-api-access-5w54j\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456006 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.455847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-socket\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456006 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.455930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-credential-socket\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456006 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.455974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istiod-ca-cert\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456006 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.455999    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-data\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.456054    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-certs\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.456073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-podinfo\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.456100    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-envoy\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.456185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.456124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-token\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.556608 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w54j\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-kube-api-access-5w54j\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.556854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-socket\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.556854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556736    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-credential-socket\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.556854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istiod-ca-cert\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.556854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-data\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556876    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-certs\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-podinfo\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-envoy\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.556957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-token\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.557017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-socket\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557332 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.557222    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-credential-socket\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557332 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.557247    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-data\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557332 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.557272    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-certs\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.557561 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.557539    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istiod-ca-cert\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.559602 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.559578    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-envoy\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.559866 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.559846    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-podinfo\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.565321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.565286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w54j\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-kube-api-access-5w54j\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.568193 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.568168    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-token\") pod \"e2e-derive-42733177-openshift-default-76f8d864-f994z\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") " pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.608909 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.608870    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:57.697140 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.697034    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:57.717742 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.717706    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf21c8a-9c83-4520-8594-d45cb80d0fd3" path="/var/lib/kubelet/pods/acf21c8a-9c83-4520-8594-d45cb80d0fd3/volumes"
Jul 28 21:14:57.718181 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.718161    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec4fa64b-a131-41cc-8c70-0f096b939303" path="/var/lib/kubelet/pods/ec4fa64b-a131-41cc-8c70-0f096b939303/volumes"
Jul 28 21:14:57.842752 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.842725    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"]
Jul 28 21:14:57.844383 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:14:57.844356    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f619e73_b1da_43f0_984a_8cc03f7a3b14.slice/crio-7486d7836b0726582f3bcda899a637e63bcb206ea0f5aabcb2f7564d044c99e6 WatchSource:0}: Error finding container 7486d7836b0726582f3bcda899a637e63bcb206ea0f5aabcb2f7564d044c99e6: Status 404 returned error can't find the container with id 7486d7836b0726582f3bcda899a637e63bcb206ea0f5aabcb2f7564d044c99e6
Jul 28 21:14:57.846683 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.846653    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:57.846760 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.846719    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:57.846760 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:57.846753    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:14:58.361282 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:58.361246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" event={"ID":"3f619e73-b1da-43f0-984a-8cc03f7a3b14","Type":"ContainerStarted","Data":"eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0"}
Jul 28 21:14:58.361457 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:58.361299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" event={"ID":"3f619e73-b1da-43f0-984a-8cc03f7a3b14","Type":"ContainerStarted","Data":"7486d7836b0726582f3bcda899a637e63bcb206ea0f5aabcb2f7564d044c99e6"}
Jul 28 21:14:58.406771 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:58.406711    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" podStartSLOduration=1.406693801 podStartE2EDuration="1.406693801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:14:58.405189221 +0000 UTC m=+1803.239432845" watchObservedRunningTime="2026-07-28 21:14:58.406693801 +0000 UTC m=+1803.240937386"
Jul 28 21:14:58.697741 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:58.697701    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:58.702661 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:58.702634    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:59.365861 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.365832    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:59.367065 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.367041    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:14:59.792260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.792224    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:59.850754 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.850721    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"]
Jul 28 21:14:59.851131 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.851117    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy"
Jul 28 21:14:59.851186 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.851133    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy"
Jul 28 21:14:59.851227 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.851210    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44bc94b-c6c2-4849-a572-bbd1b39cb4b6" containerName="istio-proxy"
Jul 28 21:14:59.854454 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.854431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:14:59.856906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.856884    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-42733177-serving-cert\""
Jul 28 21:14:59.865147 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.865121    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"]
Jul 28 21:14:59.871651 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.871625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:59.941473 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.941279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:14:59.980816 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.980759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hf4\" (UniqueName: \"kubernetes.io/projected/51648129-8023-46d9-962d-f8c1a3d546ac-kube-api-access-n2hf4\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:14:59.980986 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.980850    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:14:59.980986 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:14:59.980973    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51648129-8023-46d9-962d-f8c1a3d546ac-openshift-service-ca\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.082487 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.082407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51648129-8023-46d9-962d-f8c1a3d546ac-openshift-service-ca\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.082487 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.082460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hf4\" (UniqueName: \"kubernetes.io/projected/51648129-8023-46d9-962d-f8c1a3d546ac-kube-api-access-n2hf4\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.082677 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.082503    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.082677 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:00.082646    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-42733177-serving-cert: secret "maas-api-e2e-derive-42733177-serving-cert" not found
Jul 28 21:15:00.082753 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:00.082738    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls podName:51648129-8023-46d9-962d-f8c1a3d546ac nodeName:}" failed. No retries permitted until 2026-07-28 21:15:00.582716133 +0000 UTC m=+1805.416959698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls") pod "maas-api-e2e-derive-42733177-68d899b9dd-6zmcs" (UID: "51648129-8023-46d9-962d-f8c1a3d546ac") : secret "maas-api-e2e-derive-42733177-serving-cert" not found
Jul 28 21:15:00.083200 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.083180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51648129-8023-46d9-962d-f8c1a3d546ac-openshift-service-ca\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.094712 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.094681    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hf4\" (UniqueName: \"kubernetes.io/projected/51648129-8023-46d9-962d-f8c1a3d546ac-kube-api-access-n2hf4\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.206667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.206633    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:00.333856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.333742    2572 patch_prober.go:28] interesting pod/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:15:00.333856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.333813    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:15:00.382489 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.382443    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:00.491004 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.490965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:00.492058 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.492038    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"]
Jul 28 21:15:00.495592 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.495577    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.498040 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.498016    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-42733177\""
Jul 28 21:15:00.498163 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.498108    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-42733177-dockercfg-f9ftx\""
Jul 28 21:15:00.505885 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.505862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"]
Jul 28 21:15:00.588191 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.588105    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc7mh\" (UniqueName: \"kubernetes.io/projected/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-kube-api-access-wc7mh\") pod \"payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.588370 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.588188    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.588370 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.588252    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.591999 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.591964    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls\") pod \"maas-api-e2e-derive-42733177-68d899b9dd-6zmcs\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.688949 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.688906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc7mh\" (UniqueName: \"kubernetes.io/projected/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-kube-api-access-wc7mh\") pod \"payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.689131 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.688970    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.689737 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.689717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.697558 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.697526    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc7mh\" (UniqueName: \"kubernetes.io/projected/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-kube-api-access-wc7mh\") pod \"payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.767478 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.767444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:00.807675 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.807638    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:00.933399 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.933263    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"]
Jul 28 21:15:00.936003 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:15:00.935962    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51648129_8023_46d9_962d_f8c1a3d546ac.slice/crio-17fa9d3f325e82d091c727cb1be273a417494ed2e664b2bd47867cc8270f3e6f WatchSource:0}: Error finding container 17fa9d3f325e82d091c727cb1be273a417494ed2e664b2bd47867cc8270f3e6f: Status 404 returned error can't find the container with id 17fa9d3f325e82d091c727cb1be273a417494ed2e664b2bd47867cc8270f3e6f
Jul 28 21:15:00.985986 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:00.985800    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"]
Jul 28 21:15:00.988754 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:15:00.988725    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6a407c_c35a_4bb3_bb9a_9bd5d0df100f.slice/crio-746d0504449a1e6ea2e1ee9b2a9666a0883d11dbee04f94093423668182f0276 WatchSource:0}: Error finding container 746d0504449a1e6ea2e1ee9b2a9666a0883d11dbee04f94093423668182f0276: Status 404 returned error can't find the container with id 746d0504449a1e6ea2e1ee9b2a9666a0883d11dbee04f94093423668182f0276
Jul 28 21:15:01.376863 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.376818    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs" event={"ID":"51648129-8023-46d9-962d-f8c1a3d546ac","Type":"ContainerStarted","Data":"17fa9d3f325e82d091c727cb1be273a417494ed2e664b2bd47867cc8270f3e6f"}
Jul 28 21:15:01.378738 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.378706    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l" event={"ID":"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f","Type":"ContainerStarted","Data":"0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58"}
Jul 28 21:15:01.378894 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.378866    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:01.378951 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.378919    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l" event={"ID":"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f","Type":"ContainerStarted","Data":"746d0504449a1e6ea2e1ee9b2a9666a0883d11dbee04f94093423668182f0276"}
Jul 28 21:15:01.396632 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.396580    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l" podStartSLOduration=1.3965657089999999 podStartE2EDuration="1.396565709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:15:01.393934298 +0000 UTC m=+1806.228177875" watchObservedRunningTime="2026-07-28 21:15:01.396565709 +0000 UTC m=+1806.230809584"
Jul 28 21:15:01.843130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.843101    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:15:01.899550 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899456    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-credential-socket\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899550 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899495    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-token\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899550 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899549    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-data\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899581    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrnl7\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-kube-api-access-qrnl7\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899638    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-envoy\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899660    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-certs\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899714    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-podinfo\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899738    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093c4f5-6878-4478-8d8c-c7993681abdb-istiod-ca-cert\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.899840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899757    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:01.899840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899811    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-socket\") pod \"1093c4f5-6878-4478-8d8c-c7993681abdb\" (UID: \"1093c4f5-6878-4478-8d8c-c7993681abdb\") "
Jul 28 21:15:01.900213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.899969    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:01.900213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.900170    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:01.900213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.900187    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:01.900213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.900195    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:01.900420 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.900367    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1093c4f5-6878-4478-8d8c-c7993681abdb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:15:01.900641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.900526    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-data" (OuterVolumeSpecName: "istio-data") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:01.902341 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.902310    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-kube-api-access-qrnl7" (OuterVolumeSpecName: "kube-api-access-qrnl7") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "kube-api-access-qrnl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:15:01.902467 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.902334    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:01.902829 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.902799    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-token" (OuterVolumeSpecName: "istio-token") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:15:01.903093 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:01.903070    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1093c4f5-6878-4478-8d8c-c7993681abdb" (UID: "1093c4f5-6878-4478-8d8c-c7993681abdb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:15:02.001149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.001113    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:02.001149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.001143    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:02.001149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.001153    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1093c4f5-6878-4478-8d8c-c7993681abdb-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:02.001421 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.001162    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:02.001421 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.001170    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:02.001421 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.001178    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1093c4f5-6878-4478-8d8c-c7993681abdb-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:02.001421 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.001186    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrnl7\" (UniqueName: \"kubernetes.io/projected/1093c4f5-6878-4478-8d8c-c7993681abdb-kube-api-access-qrnl7\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:02.384958 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.384912    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs" event={"ID":"51648129-8023-46d9-962d-f8c1a3d546ac","Type":"ContainerStarted","Data":"5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f"}
Jul 28 21:15:02.385166 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.384983    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:02.386662 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.386636    2572 generic.go:356] "Generic (PLEG): container finished" podID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerID="fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0" exitCode=0
Jul 28 21:15:02.386738 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.386678    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"
Jul 28 21:15:02.386798 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.386726    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" event={"ID":"1093c4f5-6878-4478-8d8c-c7993681abdb","Type":"ContainerDied","Data":"fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0"}
Jul 28 21:15:02.386838 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.386774    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72" event={"ID":"1093c4f5-6878-4478-8d8c-c7993681abdb","Type":"ContainerDied","Data":"7b9478cfb06eac54c95369bd1bf839854bc0f7170040b65cc8cf23ebeaad7dd8"}
Jul 28 21:15:02.386838 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.386824    2572 scope.go:117] "RemoveContainer" containerID="fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0"
Jul 28 21:15:02.396662 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.396645    2572 scope.go:117] "RemoveContainer" containerID="68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43"
Jul 28 21:15:02.402742 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.402695    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs" podStartSLOduration=2.717716861 podStartE2EDuration="3.402681263s" totalImagesPullingTime="684.964402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:15:02.40168354 +0000 UTC m=+1807.235927126" watchObservedRunningTime="2026-07-28 21:15:02.402681263 +0000 UTC m=+1807.236924843"
Jul 28 21:15:02.405472 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.405452    2572 scope.go:117] "RemoveContainer" containerID="fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0"
Jul 28 21:15:02.405767 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:02.405747    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0\": container with ID starting with fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0 not found: ID does not exist" containerID="fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0"
Jul 28 21:15:02.405945 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.405888    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0"} err="failed to get container status \"fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0\": rpc error: code = NotFound desc = could not find container \"fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0\": container with ID starting with fffe2630249d55570814a176dd5a3f74a193f590c983ccabc8b38d5b490becc0 not found: ID does not exist"
Jul 28 21:15:02.405945 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.405918    2572 scope.go:117] "RemoveContainer" containerID="68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43"
Jul 28 21:15:02.406211 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:02.406194    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43\": container with ID starting with 68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43 not found: ID does not exist" containerID="68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43"
Jul 28 21:15:02.406247 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.406217    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43"} err="failed to get container status \"68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43\": rpc error: code = NotFound desc = could not find container \"68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43\": container with ID starting with 68bab397a98e58d9d3df85a91e61adada7232303778283db4a6f5c1411f06d43 not found: ID does not exist"
Jul 28 21:15:02.415598 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.415576    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"]
Jul 28 21:15:02.419601 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:02.419581    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72"]
Jul 28 21:15:03.717953 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:03.717918    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" path="/var/lib/kubelet/pods/1093c4f5-6878-4478-8d8c-c7993681abdb/volumes"
Jul 28 21:15:08.403052 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:08.403017    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:12.388879 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:12.388827    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l" podUID="0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.47:9004: connect: connection refused"
Jul 28 21:15:13.175281 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:13.175194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:13.447925 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:13.447890    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerID="eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0" exitCode=0
Jul 28 21:15:13.448346 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:13.447946    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" event={"ID":"3f619e73-b1da-43f0-984a-8cc03f7a3b14","Type":"ContainerDied","Data":"eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0"}
Jul 28 21:15:13.448399 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:13.448363    2572 scope.go:117] "RemoveContainer" containerID="eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0"
Jul 28 21:15:13.449381 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:13.449354    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:15:13.449435 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:13.449423    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:15:13.449484 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:13.449471    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:15:14.366534 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:14.366483    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:15:14.454624 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:14.454593    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" event={"ID":"3f619e73-b1da-43f0-984a-8cc03f7a3b14","Type":"ContainerStarted","Data":"3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d"}
Jul 28 21:15:14.698205 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:14.698167    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:15:14.699379 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:14.699342    2572 patch_prober.go:28] interesting pod/e2e-derive-42733177-openshift-default-76f8d864-f994z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 21:15:14.699531 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:14.699424    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 21:15:15.698269 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:15.698225    2572 patch_prober.go:28] interesting pod/e2e-derive-42733177-openshift-default-76f8d864-f994z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 21:15:15.698731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:15.698340    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 21:15:16.697981 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:16.697939    2572 patch_prober.go:28] interesting pod/e2e-derive-42733177-openshift-default-76f8d864-f994z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 21:15:16.698189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:16.698009    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 21:15:17.697692 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:17.697638    2572 patch_prober.go:28] interesting pod/e2e-derive-42733177-openshift-default-76f8d864-f994z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 21:15:17.698253 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:17.697721    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 21:15:18.702115 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:18.702084    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:15:18.702518 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:18.702364    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:15:18.703120 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:18.703103    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:15:22.388444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:22.388418    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:30.594179 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.594142    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"]
Jul 28 21:15:30.594732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.594401    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs" podUID="51648129-8023-46d9-962d-f8c1a3d546ac" containerName="maas-api" containerID="cri-o://5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f" gracePeriod=30
Jul 28 21:15:30.623688 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.623660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:30.660530 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.660483    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"]
Jul 28 21:15:30.660825 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.660792    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l" podUID="0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" containerName="payload-pre-processing" containerID="cri-o://0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58" gracePeriod=30
Jul 28 21:15:30.692041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.692006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:30.798317 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.798286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:30.860869 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.860743    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:30.928295 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.928269    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:30.965688 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.965661    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"]
Jul 28 21:15:30.965910 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.965885    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy" containerID="cri-o://3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d" gracePeriod=30
Jul 28 21:15:30.966606 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.966582    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:30.975805 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.975747    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls\") pod \"51648129-8023-46d9-962d-f8c1a3d546ac\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") "
Jul 28 21:15:30.976015 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.975839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51648129-8023-46d9-962d-f8c1a3d546ac-openshift-service-ca\") pod \"51648129-8023-46d9-962d-f8c1a3d546ac\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") "
Jul 28 21:15:30.976015 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.975912    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2hf4\" (UniqueName: \"kubernetes.io/projected/51648129-8023-46d9-962d-f8c1a3d546ac-kube-api-access-n2hf4\") pod \"51648129-8023-46d9-962d-f8c1a3d546ac\" (UID: \"51648129-8023-46d9-962d-f8c1a3d546ac\") "
Jul 28 21:15:30.976522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.976480    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51648129-8023-46d9-962d-f8c1a3d546ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "51648129-8023-46d9-962d-f8c1a3d546ac" (UID: "51648129-8023-46d9-962d-f8c1a3d546ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:15:30.979693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.979651    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51648129-8023-46d9-962d-f8c1a3d546ac-kube-api-access-n2hf4" (OuterVolumeSpecName: "kube-api-access-n2hf4") pod "51648129-8023-46d9-962d-f8c1a3d546ac" (UID: "51648129-8023-46d9-962d-f8c1a3d546ac"). InnerVolumeSpecName "kube-api-access-n2hf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:15:30.979693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.979685    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "51648129-8023-46d9-962d-f8c1a3d546ac" (UID: "51648129-8023-46d9-962d-f8c1a3d546ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:15:30.991002 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:30.990965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:31.076999 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.076968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-plugins-config-volume\") pod \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") "
Jul 28 21:15:31.077593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.077075    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc7mh\" (UniqueName: \"kubernetes.io/projected/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-kube-api-access-wc7mh\") pod \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\" (UID: \"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f\") "
Jul 28 21:15:31.077593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.077348    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51648129-8023-46d9-962d-f8c1a3d546ac-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:31.077593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.077396    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51648129-8023-46d9-962d-f8c1a3d546ac-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:31.077593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.077412    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2hf4\" (UniqueName: \"kubernetes.io/projected/51648129-8023-46d9-962d-f8c1a3d546ac-kube-api-access-n2hf4\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:31.078183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.078157    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" (UID: "0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:15:31.079600 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.079583    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-kube-api-access-wc7mh" (OuterVolumeSpecName: "kube-api-access-wc7mh") pod "0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" (UID: "0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f"). InnerVolumeSpecName "kube-api-access-wc7mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:15:31.178111 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.178082    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc7mh\" (UniqueName: \"kubernetes.io/projected/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-kube-api-access-wc7mh\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:31.178111 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.178108    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:31.236137 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.236105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:31.538911 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.538830    2572 generic.go:356] "Generic (PLEG): container finished" podID="51648129-8023-46d9-962d-f8c1a3d546ac" containerID="5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f" exitCode=0
Jul 28 21:15:31.538911 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.538887    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"
Jul 28 21:15:31.539130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.538921    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs" event={"ID":"51648129-8023-46d9-962d-f8c1a3d546ac","Type":"ContainerDied","Data":"5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f"}
Jul 28 21:15:31.539130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.538981    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs" event={"ID":"51648129-8023-46d9-962d-f8c1a3d546ac","Type":"ContainerDied","Data":"17fa9d3f325e82d091c727cb1be273a417494ed2e664b2bd47867cc8270f3e6f"}
Jul 28 21:15:31.539130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.539006    2572 scope.go:117] "RemoveContainer" containerID="5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f"
Jul 28 21:15:31.540221 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.540155    2572 generic.go:356] "Generic (PLEG): container finished" podID="0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" containerID="0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58" exitCode=0
Jul 28 21:15:31.540287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.540218    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"
Jul 28 21:15:31.540287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.540253    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l" event={"ID":"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f","Type":"ContainerDied","Data":"0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58"}
Jul 28 21:15:31.540373 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.540306    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l" event={"ID":"0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f","Type":"ContainerDied","Data":"746d0504449a1e6ea2e1ee9b2a9666a0883d11dbee04f94093423668182f0276"}
Jul 28 21:15:31.548199 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.548079    2572 scope.go:117] "RemoveContainer" containerID="5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f"
Jul 28 21:15:31.548401 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:31.548373    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f\": container with ID starting with 5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f not found: ID does not exist" containerID="5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f"
Jul 28 21:15:31.548493 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.548412    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f"} err="failed to get container status \"5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f\": rpc error: code = NotFound desc = could not find container \"5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f\": container with ID starting with 5951f8ccabeec0fed416cc238b9a930ebd3365ce2083c200275a9bd6fe430e8f not found: ID does not exist"
Jul 28 21:15:31.548493 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.548435    2572 scope.go:117] "RemoveContainer" containerID="0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58"
Jul 28 21:15:31.557403 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.557385    2572 scope.go:117] "RemoveContainer" containerID="0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58"
Jul 28 21:15:31.557665 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:31.557646    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58\": container with ID starting with 0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58 not found: ID does not exist" containerID="0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58"
Jul 28 21:15:31.557722 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.557672    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58"} err="failed to get container status \"0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58\": rpc error: code = NotFound desc = could not find container \"0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58\": container with ID starting with 0b546d270e81d8c65fb537412d13c26794bc5f05122a38ad7b81219b07963e58 not found: ID does not exist"
Jul 28 21:15:31.563802 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.563764    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"]
Jul 28 21:15:31.567396 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.567375    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42733177-68d899b9dd-6zmcs"]
Jul 28 21:15:31.577392 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.577158    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"]
Jul 28 21:15:31.579033 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.579011    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l"]
Jul 28 21:15:31.718339 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.718306    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" path="/var/lib/kubelet/pods/0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f/volumes"
Jul 28 21:15:31.718764 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.718749    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51648129-8023-46d9-962d-f8c1a3d546ac" path="/var/lib/kubelet/pods/51648129-8023-46d9-962d-f8c1a3d546ac/volumes"
Jul 28 21:15:31.727202 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.727173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:31.827643 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:31.827569    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:32.189814 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:32.189737    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:33.548675 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:33.548644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:33.705222 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:33.705190    2572 patch_prober.go:28] interesting pod/e2e-derive-42733177-openshift-default-76f8d864-f994z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:15:33.705384 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:33.705257    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:15:36.229172 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.229101    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:15:36.330860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.330824    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w54j\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-kube-api-access-5w54j\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.330860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.330862    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-socket\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331142 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.330909    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-data\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331142 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331091    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-token\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331252 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331141    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istiod-ca-cert\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331252 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331197    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-podinfo\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331252 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331229    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-certs\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331252    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-envoy\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331271    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:36.331444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331301    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-credential-socket\") pod \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\" (UID: \"3f619e73-b1da-43f0-984a-8cc03f7a3b14\") "
Jul 28 21:15:36.331598 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331497    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:36.331598 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331570    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:15:36.331736 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331713    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:36.331827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331761    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.331827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331802    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.331827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.331818    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.332134 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.332111    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:36.333444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.333408    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-kube-api-access-5w54j" (OuterVolumeSpecName: "kube-api-access-5w54j") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "kube-api-access-5w54j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:15:36.333444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.333408    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:15:36.333619 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.333541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:15:36.333999 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.333971    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f619e73-b1da-43f0-984a-8cc03f7a3b14" (UID: "3f619e73-b1da-43f0-984a-8cc03f7a3b14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:15:36.433233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.433195    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.433233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.433222    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.433233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.433233    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.433233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.433240    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.433507 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.433248    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f619e73-b1da-43f0-984a-8cc03f7a3b14-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.433507 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.433257    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w54j\" (UniqueName: \"kubernetes.io/projected/3f619e73-b1da-43f0-984a-8cc03f7a3b14-kube-api-access-5w54j\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:15:36.567669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.567576    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerID="3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d" exitCode=0
Jul 28 21:15:36.567669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.567632    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"
Jul 28 21:15:36.567669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.567661    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" event={"ID":"3f619e73-b1da-43f0-984a-8cc03f7a3b14","Type":"ContainerDied","Data":"3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d"}
Jul 28 21:15:36.567909 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.567738    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z" event={"ID":"3f619e73-b1da-43f0-984a-8cc03f7a3b14","Type":"ContainerDied","Data":"7486d7836b0726582f3bcda899a637e63bcb206ea0f5aabcb2f7564d044c99e6"}
Jul 28 21:15:36.567909 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.567764    2572 scope.go:117] "RemoveContainer" containerID="3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d"
Jul 28 21:15:36.578600 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.578577    2572 scope.go:117] "RemoveContainer" containerID="eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0"
Jul 28 21:15:36.587098 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.587070    2572 scope.go:117] "RemoveContainer" containerID="3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d"
Jul 28 21:15:36.587498 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:36.587467    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d\": container with ID starting with 3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d not found: ID does not exist" containerID="3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d"
Jul 28 21:15:36.587616 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.587509    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d"} err="failed to get container status \"3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d\": rpc error: code = NotFound desc = could not find container \"3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d\": container with ID starting with 3b109606c827652f1b74f4905c1f265bdc6ec1277cdccd0198f3e9cc1abd362d not found: ID does not exist"
Jul 28 21:15:36.587616 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.587535    2572 scope.go:117] "RemoveContainer" containerID="eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0"
Jul 28 21:15:36.587999 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:15:36.587978    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0\": container with ID starting with eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0 not found: ID does not exist" containerID="eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0"
Jul 28 21:15:36.588120 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.588001    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0"} err="failed to get container status \"eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0\": rpc error: code = NotFound desc = could not find container \"eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0\": container with ID starting with eb965a8b80c60517d33cdf849a7b4b70b855472520c0fa30f75555224c3a5ba0 not found: ID does not exist"
Jul 28 21:15:36.589292 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.589269    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"]
Jul 28 21:15:36.595179 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:36.595157    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z"]
Jul 28 21:15:37.717476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:37.717443    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" path="/var/lib/kubelet/pods/3f619e73-b1da-43f0-984a-8cc03f7a3b14/volumes"
Jul 28 21:15:40.406958 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:40.406922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:40.514323 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:40.514288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:40.608032 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:40.608000    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:40.788075 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:40.787994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:15:41.260157 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:15:41.260121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:07.268240 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:07.268201    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:13.986061 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:13.986022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:14.175739 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:14.175698    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:14.260652 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:14.260572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:20.438871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:20.438715    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:30.271879 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:30.271836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:36.689524 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:36.689485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:36.828438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:36.828406    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:36.952409 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:36.952315    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:40.487295 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:40.487259    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:47.521904 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:47.521867    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:48.434499 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:48.434464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:55.725445 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:55.725412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:55.852471 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:55.852432    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:56.112053 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:56.111965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:16:56.213211 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:16:56.213178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:07.719005 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:07.718971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:07.837772 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:07.837743    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:07.950684 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:07.950641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:09.937824 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:09.937749    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:16.455703 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:16.455657    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:16.556309 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:16.556273    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:17.338042 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:17.338000    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:24.027230 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.027190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:24.132793 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.132757    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:24.288860 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.288739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:24.639093 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639053    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"]
Jul 28 21:17:24.639430 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639417    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy"
Jul 28 21:17:24.639476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639433    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy"
Jul 28 21:17:24.639476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639447    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51648129-8023-46d9-962d-f8c1a3d546ac" containerName="maas-api"
Jul 28 21:17:24.639476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639453    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="51648129-8023-46d9-962d-f8c1a3d546ac" containerName="maas-api"
Jul 28 21:17:24.639476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639459    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy"
Jul 28 21:17:24.639476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639464    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy"
Jul 28 21:17:24.639476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639471    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy"
Jul 28 21:17:24.639476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639476    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639484    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" containerName="payload-pre-processing"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639489    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" containerName="payload-pre-processing"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639498    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639503    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639564    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639572    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639578    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="51648129-8023-46d9-962d-f8c1a3d546ac" containerName="maas-api"
Jul 28 21:17:24.639693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.639585    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d6a407c-c35a-4bb3-bb9a-9bd5d0df100f" containerName="payload-pre-processing"
Jul 28 21:17:24.642737 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.642717    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.647339 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.647312    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d0e37f3c-openshift-default-dockercfg-ggns7\""
Jul 28 21:17:24.669623 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.669587    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"]
Jul 28 21:17:24.676528 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-credential-socket\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676728 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b718de2-9757-4bcb-9066-bb18664ab4a0-istiod-ca-cert\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676728 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-certs\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676728 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-data\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676728 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676689    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-podinfo\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676971 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzt5c\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-kube-api-access-nzt5c\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676971 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676833    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-socket\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676971 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-token\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.676971 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.676931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-envoy\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.693732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.693693    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:24.777890 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.777837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-data\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778118 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.777905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-podinfo\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778118 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.777957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzt5c\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-kube-api-access-nzt5c\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778118 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-socket\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778118 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-token\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778352 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-envoy\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778352 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-credential-socket\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778352 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-data\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778515 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b718de2-9757-4bcb-9066-bb18664ab4a0-istiod-ca-cert\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778515 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-certs\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778515 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-socket\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778800 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-credential-socket\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.778800 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.778739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-certs\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.779071 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.779050    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b718de2-9757-4bcb-9066-bb18664ab4a0-istiod-ca-cert\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.780585 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.780564    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-envoy\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.780706 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.780658    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-podinfo\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.806284 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.806251    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzt5c\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-kube-api-access-nzt5c\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.823194 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.823149    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-token\") pod \"e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") " pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:24.829911 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.829871    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:24.953856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:24.953740    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:25.113886 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:25.113733    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"]
Jul 28 21:17:25.116098 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:17:25.116070    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b718de2_9757_4bcb_9066_bb18664ab4a0.slice/crio-0fa9e0ac5ec502e8725ce3bb4ccab1df9cfb5cccb312b37e6322860b978dfaf0 WatchSource:0}: Error finding container 0fa9e0ac5ec502e8725ce3bb4ccab1df9cfb5cccb312b37e6322860b978dfaf0: Status 404 returned error can't find the container with id 0fa9e0ac5ec502e8725ce3bb4ccab1df9cfb5cccb312b37e6322860b978dfaf0
Jul 28 21:17:25.118318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:25.118287    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:17:25.118399 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:25.118352    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:17:25.118399 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:25.118383    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:17:26.087880 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:26.087832    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" event={"ID":"7b718de2-9757-4bcb-9066-bb18664ab4a0","Type":"ContainerStarted","Data":"d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac"}
Jul 28 21:17:26.088076 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:26.087901    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" event={"ID":"7b718de2-9757-4bcb-9066-bb18664ab4a0","Type":"ContainerStarted","Data":"0fa9e0ac5ec502e8725ce3bb4ccab1df9cfb5cccb312b37e6322860b978dfaf0"}
Jul 28 21:17:26.954422 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:26.954391    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:26.960441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:26.960415    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:27.024883 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:27.024822    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" podStartSLOduration=3.024803603 podStartE2EDuration="3.024803603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:26.118814835 +0000 UTC m=+1950.953058421" watchObservedRunningTime="2026-07-28 21:17:27.024803603 +0000 UTC m=+1951.859047186"
Jul 28 21:17:27.092800 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:27.092742    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:27.093834 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:27.093802    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:28.433059 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.433021    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:28.567875 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.567829    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"]
Jul 28 21:17:28.568358 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.568340    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1093c4f5-6878-4478-8d8c-c7993681abdb" containerName="istio-proxy"
Jul 28 21:17:28.568462 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.568361    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f619e73-b1da-43f0-984a-8cc03f7a3b14" containerName="istio-proxy"
Jul 28 21:17:28.571416 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.571394    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.574589 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.574564    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d0e37f3c-serving-cert\""
Jul 28 21:17:28.604947 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.604900    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"]
Jul 28 21:17:28.618685 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.618649    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac4af17-9114-4911-a0af-dfaacbccea28-openshift-service-ca\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.618685 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.618688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7r8\" (UniqueName: \"kubernetes.io/projected/0ac4af17-9114-4911-a0af-dfaacbccea28-kube-api-access-bk7r8\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.618961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.618806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.625804 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.625746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:28.720012 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.719908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac4af17-9114-4911-a0af-dfaacbccea28-openshift-service-ca\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.720012 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.719950    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7r8\" (UniqueName: \"kubernetes.io/projected/0ac4af17-9114-4911-a0af-dfaacbccea28-kube-api-access-bk7r8\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.720012 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.719994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.720318 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:17:28.720123    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-serving-cert: secret "maas-api-e2e-mt-d0e37f3c-serving-cert" not found
Jul 28 21:17:28.720318 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:17:28.720191    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls podName:0ac4af17-9114-4911-a0af-dfaacbccea28 nodeName:}" failed. No retries permitted until 2026-07-28 21:17:29.22017357 +0000 UTC m=+1954.054417134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls") pod "maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m" (UID: "0ac4af17-9114-4911-a0af-dfaacbccea28") : secret "maas-api-e2e-mt-d0e37f3c-serving-cert" not found
Jul 28 21:17:28.720680 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.720655    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac4af17-9114-4911-a0af-dfaacbccea28-openshift-service-ca\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:28.749809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:28.749742    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7r8\" (UniqueName: \"kubernetes.io/projected/0ac4af17-9114-4911-a0af-dfaacbccea28-kube-api-access-bk7r8\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:29.014834 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:29.014714    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:29.225314 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:29.225264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:29.227873 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:29.227848    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls\") pod \"maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:29.332824 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:29.332714    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:29.482854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:29.482815    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:29.674575 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:29.674550    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"]
Jul 28 21:17:29.676480 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:17:29.676427    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac4af17_9114_4911_a0af_dfaacbccea28.slice/crio-e3c4b4dc5c76306978538afde8f17276267e52a3cb029713ea76e7e442285afd WatchSource:0}: Error finding container e3c4b4dc5c76306978538afde8f17276267e52a3cb029713ea76e7e442285afd: Status 404 returned error can't find the container with id e3c4b4dc5c76306978538afde8f17276267e52a3cb029713ea76e7e442285afd
Jul 28 21:17:29.949055 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:29.948970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:30.110880 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.110847    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m" event={"ID":"0ac4af17-9114-4911-a0af-dfaacbccea28","Type":"ContainerStarted","Data":"e3c4b4dc5c76306978538afde8f17276267e52a3cb029713ea76e7e442285afd"}
Jul 28 21:17:30.123890 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.123863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:30.235588 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.235477    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"]
Jul 28 21:17:30.242025 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.241994    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.245582 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.245555    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d0e37f3c\""
Jul 28 21:17:30.264508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.264477    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"]
Jul 28 21:17:30.337045 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.337005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5de1504-3938-45a7-b1ee-b7d135ca51cb-plugins-config-volume\") pod \"payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") " pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.337242 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.337060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw228\" (UniqueName: \"kubernetes.io/projected/e5de1504-3938-45a7-b1ee-b7d135ca51cb-kube-api-access-gw228\") pod \"payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") " pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.347541 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.347500    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"]
Jul 28 21:17:30.350961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.350944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.358936 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.358916    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d0e37f3c-dockercfg-cpdm6\""
Jul 28 21:17:30.389440 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.389403    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"]
Jul 28 21:17:30.437964 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.437924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6lg\" (UniqueName: \"kubernetes.io/projected/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-kube-api-access-sz6lg\") pod \"payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.437964 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.437966    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.438224 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.438024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5de1504-3938-45a7-b1ee-b7d135ca51cb-plugins-config-volume\") pod \"payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") " pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.438224 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.438055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw228\" (UniqueName: \"kubernetes.io/projected/e5de1504-3938-45a7-b1ee-b7d135ca51cb-kube-api-access-gw228\") pod \"payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") " pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.438831 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.438807    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5de1504-3938-45a7-b1ee-b7d135ca51cb-plugins-config-volume\") pod \"payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") " pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.449226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.449196    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw228\" (UniqueName: \"kubernetes.io/projected/e5de1504-3938-45a7-b1ee-b7d135ca51cb-kube-api-access-gw228\") pod \"payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") " pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.539538 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.539437    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6lg\" (UniqueName: \"kubernetes.io/projected/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-kube-api-access-sz6lg\") pod \"payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.539538 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.539482    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.540478 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.540454    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.551949 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.551922    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6lg\" (UniqueName: \"kubernetes.io/projected/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-kube-api-access-sz6lg\") pod \"payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.553689 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.553671    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:30.661515 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.661480    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:30.721332 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.721263    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"]
Jul 28 21:17:30.724570 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:17:30.723941    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5de1504_3938_45a7_b1ee_b7d135ca51cb.slice/crio-b0dd4b5e0fe98c416ee51c754514a7ff7ed018bbbacbd10cd2e9b4be65b9268b WatchSource:0}: Error finding container b0dd4b5e0fe98c416ee51c754514a7ff7ed018bbbacbd10cd2e9b4be65b9268b: Status 404 returned error can't find the container with id b0dd4b5e0fe98c416ee51c754514a7ff7ed018bbbacbd10cd2e9b4be65b9268b
Jul 28 21:17:30.839213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:30.839186    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"]
Jul 28 21:17:30.841650 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:17:30.841624    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d35f87_0b6e_4d45_88e1_b4eba7f5d726.slice/crio-b4b196eead41f3261d9e1189e67a989ab32376a473d9b4db0edb951511d9ef8a WatchSource:0}: Error finding container b4b196eead41f3261d9e1189e67a989ab32376a473d9b4db0edb951511d9ef8a: Status 404 returned error can't find the container with id b4b196eead41f3261d9e1189e67a989ab32376a473d9b4db0edb951511d9ef8a
Jul 28 21:17:31.118428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.118295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m" event={"ID":"0ac4af17-9114-4911-a0af-dfaacbccea28","Type":"ContainerStarted","Data":"eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa"}
Jul 28 21:17:31.118428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.118420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:31.120165 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.120123    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx" event={"ID":"04d35f87-0b6e-4d45-88e1-b4eba7f5d726","Type":"ContainerStarted","Data":"eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624"}
Jul 28 21:17:31.120339 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.120194    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:31.120339 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.120220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx" event={"ID":"04d35f87-0b6e-4d45-88e1-b4eba7f5d726","Type":"ContainerStarted","Data":"b4b196eead41f3261d9e1189e67a989ab32376a473d9b4db0edb951511d9ef8a"}
Jul 28 21:17:31.121932 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.121902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2" event={"ID":"e5de1504-3938-45a7-b1ee-b7d135ca51cb","Type":"ContainerStarted","Data":"1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526"}
Jul 28 21:17:31.122095 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.121957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2" event={"ID":"e5de1504-3938-45a7-b1ee-b7d135ca51cb","Type":"ContainerStarted","Data":"b0dd4b5e0fe98c416ee51c754514a7ff7ed018bbbacbd10cd2e9b4be65b9268b"}
Jul 28 21:17:31.122095 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.121985    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:31.152571 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.152515    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m" podStartSLOduration=2.435230011 podStartE2EDuration="3.152499615s" totalImagesPullingTime="717.269604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:31.150917167 +0000 UTC m=+1955.985160753" watchObservedRunningTime="2026-07-28 21:17:31.152499615 +0000 UTC m=+1955.986743200"
Jul 28 21:17:31.184298 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.184232    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx" podStartSLOduration=1.184210763 podStartE2EDuration="1.184210763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:31.182054904 +0000 UTC m=+1956.016298493" watchObservedRunningTime="2026-07-28 21:17:31.184210763 +0000 UTC m=+1956.018454353"
Jul 28 21:17:31.214727 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:31.214672    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2" podStartSLOduration=1.214654041 podStartE2EDuration="1.214654041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:31.213547512 +0000 UTC m=+1956.047791106" watchObservedRunningTime="2026-07-28 21:17:31.214654041 +0000 UTC m=+1956.048897618"
Jul 28 21:17:37.132920 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:37.132890    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:17:42.094250 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.094155    2572 patch_prober.go:28] interesting pod/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 21:17:42.094250 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.094212    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 21:17:42.129908 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.129872    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:17:42.130078 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.129959    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:17:42.184737 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.184705    2572 generic.go:356] "Generic (PLEG): container finished" podID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerID="d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac" exitCode=0
Jul 28 21:17:42.184939 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.184818    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" event={"ID":"7b718de2-9757-4bcb-9066-bb18664ab4a0","Type":"ContainerDied","Data":"d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac"}
Jul 28 21:17:42.185373 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.185346    2572 scope.go:117] "RemoveContainer" containerID="d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac"
Jul 28 21:17:42.186703 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.186667    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:17:42.186827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.186762    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:17:42.186937 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:42.186848    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:17:43.196749 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:43.196701    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" event={"ID":"7b718de2-9757-4bcb-9066-bb18664ab4a0","Type":"ContainerStarted","Data":"6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53"}
Jul 28 21:17:43.954885 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:43.954845    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:43.955137 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:43.955111    2572 patch_prober.go:28] interesting pod/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 21:17:43.955228 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:43.955188    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 21:17:44.954822 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:44.954762    2572 patch_prober.go:28] interesting pod/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 21:17:44.955224 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:44.954844    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 21:17:45.954902 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:45.954861    2572 patch_prober.go:28] interesting pod/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 21:17:45.955310 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:45.954927    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 21:17:46.954871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:46.954830    2572 patch_prober.go:28] interesting pod/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 21:17:46.955091 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:46.954894    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 21:17:47.959067 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:47.959032    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:47.959474 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:47.959293    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:47.960160 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:47.960141    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:17:53.321884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:53.321851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:54.090172 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:54.090127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:54.212097 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:54.212066    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:54.583404 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:54.583372    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:17:56.162394 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:17:56.162357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:01.324927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:01.324894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:01.503615 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:01.503582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:12.243931 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.243890    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"]
Jul 28 21:18:12.244456 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.244279    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m" podUID="0ac4af17-9114-4911-a0af-dfaacbccea28" containerName="maas-api" containerID="cri-o://eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa" gracePeriod=30
Jul 28 21:18:12.279483 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.279449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:12.305473 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.305434    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"]
Jul 28 21:18:12.305752 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.305725    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2" podUID="e5de1504-3938-45a7-b1ee-b7d135ca51cb" containerName="payload-processing" containerID="cri-o://1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526" gracePeriod=30
Jul 28 21:18:12.312244 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.312212    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"]
Jul 28 21:18:12.312827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.312443    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx" podUID="04d35f87-0b6e-4d45-88e1-b4eba7f5d726" containerName="payload-pre-processing" containerID="cri-o://eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624" gracePeriod=30
Jul 28 21:18:12.348327 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.348279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:12.419226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.419195    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:12.495993 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.495762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:12.599257 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.599213    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:18:12.602297 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.602270    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:18:12.632467 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.632438    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:18:12.640127 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.640088    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac4af17-9114-4911-a0af-dfaacbccea28-openshift-service-ca\") pod \"0ac4af17-9114-4911-a0af-dfaacbccea28\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") "
Jul 28 21:18:12.640290 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.640153    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw228\" (UniqueName: \"kubernetes.io/projected/e5de1504-3938-45a7-b1ee-b7d135ca51cb-kube-api-access-gw228\") pod \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") "
Jul 28 21:18:12.640290 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.640202    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk7r8\" (UniqueName: \"kubernetes.io/projected/0ac4af17-9114-4911-a0af-dfaacbccea28-kube-api-access-bk7r8\") pod \"0ac4af17-9114-4911-a0af-dfaacbccea28\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") "
Jul 28 21:18:12.640290 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.640274    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5de1504-3938-45a7-b1ee-b7d135ca51cb-plugins-config-volume\") pod \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\" (UID: \"e5de1504-3938-45a7-b1ee-b7d135ca51cb\") "
Jul 28 21:18:12.640480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.640303    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls\") pod \"0ac4af17-9114-4911-a0af-dfaacbccea28\" (UID: \"0ac4af17-9114-4911-a0af-dfaacbccea28\") "
Jul 28 21:18:12.640608 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.640494    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac4af17-9114-4911-a0af-dfaacbccea28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ac4af17-9114-4911-a0af-dfaacbccea28" (UID: "0ac4af17-9114-4911-a0af-dfaacbccea28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:18:12.640730 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.640687    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5de1504-3938-45a7-b1ee-b7d135ca51cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5de1504-3938-45a7-b1ee-b7d135ca51cb" (UID: "e5de1504-3938-45a7-b1ee-b7d135ca51cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:18:12.642641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.642609    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ac4af17-9114-4911-a0af-dfaacbccea28" (UID: "0ac4af17-9114-4911-a0af-dfaacbccea28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:18:12.642758 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.642649    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5de1504-3938-45a7-b1ee-b7d135ca51cb-kube-api-access-gw228" (OuterVolumeSpecName: "kube-api-access-gw228") pod "e5de1504-3938-45a7-b1ee-b7d135ca51cb" (UID: "e5de1504-3938-45a7-b1ee-b7d135ca51cb"). InnerVolumeSpecName "kube-api-access-gw228". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:18:12.642972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.642952    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac4af17-9114-4911-a0af-dfaacbccea28-kube-api-access-bk7r8" (OuterVolumeSpecName: "kube-api-access-bk7r8") pod "0ac4af17-9114-4911-a0af-dfaacbccea28" (UID: "0ac4af17-9114-4911-a0af-dfaacbccea28"). InnerVolumeSpecName "kube-api-access-bk7r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:18:12.741738 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.741697    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-plugins-config-volume\") pod \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") "
Jul 28 21:18:12.741974 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.741863    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz6lg\" (UniqueName: \"kubernetes.io/projected/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-kube-api-access-sz6lg\") pod \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\" (UID: \"04d35f87-0b6e-4d45-88e1-b4eba7f5d726\") "
Jul 28 21:18:12.742111 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.742095    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5de1504-3938-45a7-b1ee-b7d135ca51cb-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:12.742179 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.742116    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac4af17-9114-4911-a0af-dfaacbccea28-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:12.742179 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.742170    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac4af17-9114-4911-a0af-dfaacbccea28-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:12.742265 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.742185    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw228\" (UniqueName: \"kubernetes.io/projected/e5de1504-3938-45a7-b1ee-b7d135ca51cb-kube-api-access-gw228\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:12.742265 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.742109    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04d35f87-0b6e-4d45-88e1-b4eba7f5d726" (UID: "04d35f87-0b6e-4d45-88e1-b4eba7f5d726"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:18:12.742265 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.742198    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk7r8\" (UniqueName: \"kubernetes.io/projected/0ac4af17-9114-4911-a0af-dfaacbccea28-kube-api-access-bk7r8\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:12.744198 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.744164    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-kube-api-access-sz6lg" (OuterVolumeSpecName: "kube-api-access-sz6lg") pod "04d35f87-0b6e-4d45-88e1-b4eba7f5d726" (UID: "04d35f87-0b6e-4d45-88e1-b4eba7f5d726"). InnerVolumeSpecName "kube-api-access-sz6lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:18:12.843235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.843138    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz6lg\" (UniqueName: \"kubernetes.io/projected/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-kube-api-access-sz6lg\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:12.843235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.843169    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d35f87-0b6e-4d45-88e1-b4eba7f5d726-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:12.919507 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:12.919463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:13.342871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.342833    2572 generic.go:356] "Generic (PLEG): container finished" podID="0ac4af17-9114-4911-a0af-dfaacbccea28" containerID="eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa" exitCode=0
Jul 28 21:18:13.343380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.342890    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"
Jul 28 21:18:13.343380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.342909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m" event={"ID":"0ac4af17-9114-4911-a0af-dfaacbccea28","Type":"ContainerDied","Data":"eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa"}
Jul 28 21:18:13.343380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.342972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m" event={"ID":"0ac4af17-9114-4911-a0af-dfaacbccea28","Type":"ContainerDied","Data":"e3c4b4dc5c76306978538afde8f17276267e52a3cb029713ea76e7e442285afd"}
Jul 28 21:18:13.343380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.343006    2572 scope.go:117] "RemoveContainer" containerID="eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa"
Jul 28 21:18:13.344597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.344319    2572 generic.go:356] "Generic (PLEG): container finished" podID="04d35f87-0b6e-4d45-88e1-b4eba7f5d726" containerID="eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624" exitCode=0
Jul 28 21:18:13.344597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.344358    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"
Jul 28 21:18:13.344597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.344410    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx" event={"ID":"04d35f87-0b6e-4d45-88e1-b4eba7f5d726","Type":"ContainerDied","Data":"eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624"}
Jul 28 21:18:13.344597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.344467    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx" event={"ID":"04d35f87-0b6e-4d45-88e1-b4eba7f5d726","Type":"ContainerDied","Data":"b4b196eead41f3261d9e1189e67a989ab32376a473d9b4db0edb951511d9ef8a"}
Jul 28 21:18:13.346067 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.346044    2572 generic.go:356] "Generic (PLEG): container finished" podID="e5de1504-3938-45a7-b1ee-b7d135ca51cb" containerID="1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526" exitCode=0
Jul 28 21:18:13.346172 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.346102    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"
Jul 28 21:18:13.346172 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.346138    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2" event={"ID":"e5de1504-3938-45a7-b1ee-b7d135ca51cb","Type":"ContainerDied","Data":"1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526"}
Jul 28 21:18:13.346267 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.346183    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2" event={"ID":"e5de1504-3938-45a7-b1ee-b7d135ca51cb","Type":"ContainerDied","Data":"b0dd4b5e0fe98c416ee51c754514a7ff7ed018bbbacbd10cd2e9b4be65b9268b"}
Jul 28 21:18:13.354883 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.354867    2572 scope.go:117] "RemoveContainer" containerID="eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa"
Jul 28 21:18:13.355319 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:18:13.355289    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa\": container with ID starting with eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa not found: ID does not exist" containerID="eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa"
Jul 28 21:18:13.355423 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.355325    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa"} err="failed to get container status \"eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa\": rpc error: code = NotFound desc = could not find container \"eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa\": container with ID starting with eb11fab6c84b4ec0630e0cd2203575efaa5ab36766c486024e88d51e2124f6fa not found: ID does not exist"
Jul 28 21:18:13.355423 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.355344    2572 scope.go:117] "RemoveContainer" containerID="eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624"
Jul 28 21:18:13.364497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.364475    2572 scope.go:117] "RemoveContainer" containerID="eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624"
Jul 28 21:18:13.364944 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:18:13.364908    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624\": container with ID starting with eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624 not found: ID does not exist" containerID="eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624"
Jul 28 21:18:13.365042 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.364942    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624"} err="failed to get container status \"eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624\": rpc error: code = NotFound desc = could not find container \"eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624\": container with ID starting with eb259ecec669871eb412c63d7f165656c3a9486bd3bc57d379d31d63c1189624 not found: ID does not exist"
Jul 28 21:18:13.365042 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.364963    2572 scope.go:117] "RemoveContainer" containerID="1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526"
Jul 28 21:18:13.367242 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.367066    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"]
Jul 28 21:18:13.369349 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.369330    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d0e37f3c-7d4d97ddbc-6859m"]
Jul 28 21:18:13.374537 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.374516    2572 scope.go:117] "RemoveContainer" containerID="1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526"
Jul 28 21:18:13.374873 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:18:13.374850    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526\": container with ID starting with 1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526 not found: ID does not exist" containerID="1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526"
Jul 28 21:18:13.374997 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.374886    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526"} err="failed to get container status \"1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526\": rpc error: code = NotFound desc = could not find container \"1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526\": container with ID starting with 1237f719749715b030452518e3d3a4b6b5c3f20e2877dc2105d2a408319d4526 not found: ID does not exist"
Jul 28 21:18:13.379931 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.379905    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"]
Jul 28 21:18:13.385177 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.385155    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2"]
Jul 28 21:18:13.400342 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.400312    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"]
Jul 28 21:18:13.404997 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.404968    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx"]
Jul 28 21:18:13.718181 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.718145    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d35f87-0b6e-4d45-88e1-b4eba7f5d726" path="/var/lib/kubelet/pods/04d35f87-0b6e-4d45-88e1-b4eba7f5d726/volumes"
Jul 28 21:18:13.718577 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.718562    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac4af17-9114-4911-a0af-dfaacbccea28" path="/var/lib/kubelet/pods/0ac4af17-9114-4911-a0af-dfaacbccea28/volumes"
Jul 28 21:18:13.718928 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:13.718915    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5de1504-3938-45a7-b1ee-b7d135ca51cb" path="/var/lib/kubelet/pods/e5de1504-3938-45a7-b1ee-b7d135ca51cb/volumes"
Jul 28 21:18:19.166579 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.166537    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:19.289869 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.289837    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:19.428833 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.428707    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"]
Jul 28 21:18:19.429035 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.429007    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy" containerID="cri-o://6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53" gracePeriod=30
Jul 28 21:18:19.480853 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.480796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:19.670310 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.670275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:19.795252 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.795152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:19.897139 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:19.897109    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:20.036033 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:20.035994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:24.699260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.699193    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:18:24.855585 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855556    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzt5c\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-kube-api-access-nzt5c\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.855821 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855608    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-certs\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.855821 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855634    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-podinfo\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.855821 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855657    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b718de2-9757-4bcb-9066-bb18664ab4a0-istiod-ca-cert\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.855821 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855676    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-token\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.855821 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855701    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-socket\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.855821 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855803    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-credential-socket\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.856173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855847    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-data\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.856173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.855888    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-envoy\") pod \"7b718de2-9757-4bcb-9066-bb18664ab4a0\" (UID: \"7b718de2-9757-4bcb-9066-bb18664ab4a0\") "
Jul 28 21:18:24.856173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.856047    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:18:24.856173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.856141    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b718de2-9757-4bcb-9066-bb18664ab4a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:18:24.856173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.856138    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:18:24.856423 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.856208    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.856639 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.856556    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:18:24.856985 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.856960    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:18:24.858106 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.858081    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:18:24.858106 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.858094    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:18:24.858235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.858112    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-kube-api-access-nzt5c" (OuterVolumeSpecName: "kube-api-access-nzt5c") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "kube-api-access-nzt5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:18:24.858349 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.858333    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b718de2-9757-4bcb-9066-bb18664ab4a0" (UID: "7b718de2-9757-4bcb-9066-bb18664ab4a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:18:24.956842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956747    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.956842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956773    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.956842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956811    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b718de2-9757-4bcb-9066-bb18664ab4a0-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.956842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956819    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.956842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956828    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.956842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956836    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.956842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956843    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b718de2-9757-4bcb-9066-bb18664ab4a0-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:24.957159 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:24.956851    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzt5c\" (UniqueName: \"kubernetes.io/projected/7b718de2-9757-4bcb-9066-bb18664ab4a0-kube-api-access-nzt5c\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:18:25.412077 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.412039    2572 generic.go:356] "Generic (PLEG): container finished" podID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerID="6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53" exitCode=0
Jul 28 21:18:25.412301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.412083    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" event={"ID":"7b718de2-9757-4bcb-9066-bb18664ab4a0","Type":"ContainerDied","Data":"6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53"}
Jul 28 21:18:25.412301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.412141    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf" event={"ID":"7b718de2-9757-4bcb-9066-bb18664ab4a0","Type":"ContainerDied","Data":"0fa9e0ac5ec502e8725ce3bb4ccab1df9cfb5cccb312b37e6322860b978dfaf0"}
Jul 28 21:18:25.412301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.412089    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"
Jul 28 21:18:25.412301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.412173    2572 scope.go:117] "RemoveContainer" containerID="6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53"
Jul 28 21:18:25.421771 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.421752    2572 scope.go:117] "RemoveContainer" containerID="d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac"
Jul 28 21:18:25.430067 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.430046    2572 scope.go:117] "RemoveContainer" containerID="6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53"
Jul 28 21:18:25.430341 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:18:25.430322    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53\": container with ID starting with 6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53 not found: ID does not exist" containerID="6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53"
Jul 28 21:18:25.430400 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.430352    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53"} err="failed to get container status \"6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53\": rpc error: code = NotFound desc = could not find container \"6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53\": container with ID starting with 6675cec9b037da4734ef02af574806d3e7608353ed8b7b2f9b0fdea4e1f3af53 not found: ID does not exist"
Jul 28 21:18:25.430400 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.430370    2572 scope.go:117] "RemoveContainer" containerID="d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac"
Jul 28 21:18:25.430594 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:18:25.430573    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac\": container with ID starting with d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac not found: ID does not exist" containerID="d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac"
Jul 28 21:18:25.430642 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.430600    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac"} err="failed to get container status \"d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac\": rpc error: code = NotFound desc = could not find container \"d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac\": container with ID starting with d93cadf722f1e16f034573a9b13108d5b4eeed15524a250a273c7172993cc9ac not found: ID does not exist"
Jul 28 21:18:25.433774 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.433749    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"]
Jul 28 21:18:25.437559 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.437537    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf"]
Jul 28 21:18:25.717818 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:25.717723    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" path="/var/lib/kubelet/pods/7b718de2-9757-4bcb-9066-bb18664ab4a0/volumes"
Jul 28 21:18:26.265732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:26.265699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:26.377075 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:26.377039    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:26.465437 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:26.465403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:26.650555 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:26.650524    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:32.822407 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:32.822376    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:32.890659 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:32.890619    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:33.589658 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:33.589626    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:39.985202 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:39.985167    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:40.311091 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.310990    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"]
Jul 28 21:18:40.311450 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311432    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy"
Jul 28 21:18:40.311535 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311452    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy"
Jul 28 21:18:40.311535 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311486    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac4af17-9114-4911-a0af-dfaacbccea28" containerName="maas-api"
Jul 28 21:18:40.311535 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311495    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac4af17-9114-4911-a0af-dfaacbccea28" containerName="maas-api"
Jul 28 21:18:40.311535 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311510    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5de1504-3938-45a7-b1ee-b7d135ca51cb" containerName="payload-processing"
Jul 28 21:18:40.311535 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311519    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5de1504-3938-45a7-b1ee-b7d135ca51cb" containerName="payload-processing"
Jul 28 21:18:40.311535 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311535    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d35f87-0b6e-4d45-88e1-b4eba7f5d726" containerName="payload-pre-processing"
Jul 28 21:18:40.311855 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311544    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d35f87-0b6e-4d45-88e1-b4eba7f5d726" containerName="payload-pre-processing"
Jul 28 21:18:40.311855 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311638    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy"
Jul 28 21:18:40.311855 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311649    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5de1504-3938-45a7-b1ee-b7d135ca51cb" containerName="payload-processing"
Jul 28 21:18:40.311855 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311661    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d35f87-0b6e-4d45-88e1-b4eba7f5d726" containerName="payload-pre-processing"
Jul 28 21:18:40.311855 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.311671    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac4af17-9114-4911-a0af-dfaacbccea28" containerName="maas-api"
Jul 28 21:18:40.314995 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.314970    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.318342 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.318318    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2dd70051-openshift-default-dockercfg-qfd47\""
Jul 28 21:18:40.327633 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.327605    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"]
Jul 28 21:18:40.338091 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.338060    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:40.391230 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-certs\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391230 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391231    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-podinfo\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391250    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-envoy\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-socket\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391330    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2199e411-c571-4094-b8ed-81c4c5f89ba3-istiod-ca-cert\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvlwj\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-kube-api-access-tvlwj\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-credential-socket\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391625 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-token\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.391625 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.391480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-data\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.492943 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.492913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-certs\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.492943 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.492949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-podinfo\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.492967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-envoy\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.492991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-socket\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493013    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2199e411-c571-4094-b8ed-81c4c5f89ba3-istiod-ca-cert\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvlwj\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-kube-api-access-tvlwj\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493066    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-credential-socket\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493109    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-token\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493128    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-data\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493568 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-certs\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493568 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493416    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-socket\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493568 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493512    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-data\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493568 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493533    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-credential-socket\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.493856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.493836    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2199e411-c571-4094-b8ed-81c4c5f89ba3-istiod-ca-cert\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.495688 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.495662    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-envoy\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.495831 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.495770    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-podinfo\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.507839 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.507804    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-token\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.507974 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.507921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvlwj\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-kube-api-access-tvlwj\") pod \"e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") " pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.599676 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.599573    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:40.625702 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.625661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:40.777370 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.777331    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"]
Jul 28 21:18:40.781171 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:18:40.781138    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2199e411_c571_4094_b8ed_81c4c5f89ba3.slice/crio-f8dee5e858b5d074559b75787feb8f9ec248743e9dc94d992996b737a01156c1 WatchSource:0}: Error finding container f8dee5e858b5d074559b75787feb8f9ec248743e9dc94d992996b737a01156c1: Status 404 returned error can't find the container with id f8dee5e858b5d074559b75787feb8f9ec248743e9dc94d992996b737a01156c1
Jul 28 21:18:40.783345 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.783308    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:18:40.783480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.783401    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:18:40.783480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:40.783444    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:18:41.502049 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:41.502007    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" event={"ID":"2199e411-c571-4094-b8ed-81c4c5f89ba3","Type":"ContainerStarted","Data":"190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1"}
Jul 28 21:18:41.502433 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:41.502091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" event={"ID":"2199e411-c571-4094-b8ed-81c4c5f89ba3","Type":"ContainerStarted","Data":"f8dee5e858b5d074559b75787feb8f9ec248743e9dc94d992996b737a01156c1"}
Jul 28 21:18:41.524516 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:41.524449    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" podStartSLOduration=1.524431697 podStartE2EDuration="1.524431697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:18:41.521697178 +0000 UTC m=+2026.355940768" watchObservedRunningTime="2026-07-28 21:18:41.524431697 +0000 UTC m=+2026.358675283"
Jul 28 21:18:41.625877 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:41.625840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:41.636629 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:41.636588    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:42.507250 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:42.507222    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:42.508301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:42.508279    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:43.528710 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.528674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:43.618202 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.618160    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:43.619294 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.619269    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"]
Jul 28 21:18:43.619693 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.619677    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy"
Jul 28 21:18:43.619772 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.619696    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy"
Jul 28 21:18:43.619858 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.619823    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b718de2-9757-4bcb-9066-bb18664ab4a0" containerName="istio-proxy"
Jul 28 21:18:43.622960 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.622942    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.625504 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.625488    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2dd70051-serving-cert\""
Jul 28 21:18:43.632062 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.632040    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"]
Jul 28 21:18:43.695292 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.695262    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:43.723505 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.723475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f67bb7-4d38-4d7c-935f-55285ac2904a-openshift-service-ca\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.723711 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.723515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7z6l\" (UniqueName: \"kubernetes.io/projected/11f67bb7-4d38-4d7c-935f-55285ac2904a-kube-api-access-p7z6l\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.723711 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.723614    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.824500 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.824400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f67bb7-4d38-4d7c-935f-55285ac2904a-openshift-service-ca\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.824500 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.824445    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7z6l\" (UniqueName: \"kubernetes.io/projected/11f67bb7-4d38-4d7c-935f-55285ac2904a-kube-api-access-p7z6l\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.824500 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.824473    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.825029 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:18:43.825006    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-serving-cert: secret "maas-api-e2e-mt-2dd70051-serving-cert" not found
Jul 28 21:18:43.825137 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:18:43.825075    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls podName:11f67bb7-4d38-4d7c-935f-55285ac2904a nodeName:}" failed. No retries permitted until 2026-07-28 21:18:44.32505992 +0000 UTC m=+2029.159303485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls") pod "maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg" (UID: "11f67bb7-4d38-4d7c-935f-55285ac2904a") : secret "maas-api-e2e-mt-2dd70051-serving-cert" not found
Jul 28 21:18:43.825258 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.825238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f67bb7-4d38-4d7c-935f-55285ac2904a-openshift-service-ca\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:43.838172 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:43.838143    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7z6l\" (UniqueName: \"kubernetes.io/projected/11f67bb7-4d38-4d7c-935f-55285ac2904a-kube-api-access-p7z6l\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:44.090229 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.090142    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:44.294528 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.294495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:44.330308 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.330278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:44.332945 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.332918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls\") pod \"maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:44.387933 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.387896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:18:44.395350 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.395317    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"]
Jul 28 21:18:44.399063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.399043    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.401559 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.401537    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2dd70051\""
Jul 28 21:18:44.408901 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.408875    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"]
Jul 28 21:18:44.422398 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.422359    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"]
Jul 28 21:18:44.426447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.426424    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.428941 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.428917    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2dd70051-dockercfg-vr7kf\""
Jul 28 21:18:44.430818 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.430774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5dbh\" (UniqueName: \"kubernetes.io/projected/d19f8a03-4ee8-44f6-ac5d-64726f86c435-kube-api-access-p5dbh\") pod \"payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.430958 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.430938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d19f8a03-4ee8-44f6-ac5d-64726f86c435-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.435526 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.435496    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"]
Jul 28 21:18:44.531972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.531934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5dbh\" (UniqueName: \"kubernetes.io/projected/d19f8a03-4ee8-44f6-ac5d-64726f86c435-kube-api-access-p5dbh\") pod \"payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.532428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.531998    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqd4\" (UniqueName: \"kubernetes.io/projected/aa70473e-883a-45d5-bb78-829841001768-kube-api-access-8xqd4\") pod \"payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") " pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.532428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.532037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa70473e-883a-45d5-bb78-829841001768-plugins-config-volume\") pod \"payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") " pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.532428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.532068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d19f8a03-4ee8-44f6-ac5d-64726f86c435-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.532823 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.532801    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d19f8a03-4ee8-44f6-ac5d-64726f86c435-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.534859 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.534827    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:44.541102 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.541071    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5dbh\" (UniqueName: \"kubernetes.io/projected/d19f8a03-4ee8-44f6-ac5d-64726f86c435-kube-api-access-p5dbh\") pod \"payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.633362 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.633330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa70473e-883a-45d5-bb78-829841001768-plugins-config-volume\") pod \"payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") " pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.633900 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.633703    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqd4\" (UniqueName: \"kubernetes.io/projected/aa70473e-883a-45d5-bb78-829841001768-kube-api-access-8xqd4\") pod \"payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") " pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.634260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.634238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa70473e-883a-45d5-bb78-829841001768-plugins-config-volume\") pod \"payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") " pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.644144 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.644052    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqd4\" (UniqueName: \"kubernetes.io/projected/aa70473e-883a-45d5-bb78-829841001768-kube-api-access-8xqd4\") pod \"payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") " pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.685123 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.685085    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"]
Jul 28 21:18:44.688304 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:18:44.688264    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f67bb7_4d38_4d7c_935f_55285ac2904a.slice/crio-65558f0f59d95ef3bcaa816e3f542b822c8dc4f4a39addd72e0d50d292f4c6e4 WatchSource:0}: Error finding container 65558f0f59d95ef3bcaa816e3f542b822c8dc4f4a39addd72e0d50d292f4c6e4: Status 404 returned error can't find the container with id 65558f0f59d95ef3bcaa816e3f542b822c8dc4f4a39addd72e0d50d292f4c6e4
Jul 28 21:18:44.690176 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.690153    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 21:18:44.711370 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.711326    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:44.739053 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.739016    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:44.879799 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.879745    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"]
Jul 28 21:18:44.882128 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:18:44.882084    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19f8a03_4ee8_44f6_ac5d_64726f86c435.slice/crio-121ffabf63724a0b53354543024c0c78ab91cd363950d0f53ca9d09cf1593477 WatchSource:0}: Error finding container 121ffabf63724a0b53354543024c0c78ab91cd363950d0f53ca9d09cf1593477: Status 404 returned error can't find the container with id 121ffabf63724a0b53354543024c0c78ab91cd363950d0f53ca9d09cf1593477
Jul 28 21:18:44.906328 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:44.906301    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"]
Jul 28 21:18:44.908323 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:18:44.908286    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa70473e_883a_45d5_bb78_829841001768.slice/crio-dd9ebcb7aee79da99874c13744a9f3804eb79ab764a1ee764164e91b9b0e3a2a WatchSource:0}: Error finding container dd9ebcb7aee79da99874c13744a9f3804eb79ab764a1ee764164e91b9b0e3a2a: Status 404 returned error can't find the container with id dd9ebcb7aee79da99874c13744a9f3804eb79ab764a1ee764164e91b9b0e3a2a
Jul 28 21:18:45.524159 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.524032    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5" event={"ID":"aa70473e-883a-45d5-bb78-829841001768","Type":"ContainerStarted","Data":"7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db"}
Jul 28 21:18:45.524159 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.524136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5" event={"ID":"aa70473e-883a-45d5-bb78-829841001768","Type":"ContainerStarted","Data":"dd9ebcb7aee79da99874c13744a9f3804eb79ab764a1ee764164e91b9b0e3a2a"}
Jul 28 21:18:45.524390 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.524171    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:45.525522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.525501    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg" event={"ID":"d19f8a03-4ee8-44f6-ac5d-64726f86c435","Type":"ContainerStarted","Data":"18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52"}
Jul 28 21:18:45.525619 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.525542    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg" event={"ID":"d19f8a03-4ee8-44f6-ac5d-64726f86c435","Type":"ContainerStarted","Data":"121ffabf63724a0b53354543024c0c78ab91cd363950d0f53ca9d09cf1593477"}
Jul 28 21:18:45.525619 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.525585    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:45.526865 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.526840    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg" event={"ID":"11f67bb7-4d38-4d7c-935f-55285ac2904a","Type":"ContainerStarted","Data":"ca2ec167090a7b3f940e81b44356252033e8886a1305c4d0edf950a030377cf1"}
Jul 28 21:18:45.526973 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.526890    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg" event={"ID":"11f67bb7-4d38-4d7c-935f-55285ac2904a","Type":"ContainerStarted","Data":"65558f0f59d95ef3bcaa816e3f542b822c8dc4f4a39addd72e0d50d292f4c6e4"}
Jul 28 21:18:45.526973 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.526919    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:45.541277 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.541081    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5" podStartSLOduration=1.54106115 podStartE2EDuration="1.54106115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:18:45.540858522 +0000 UTC m=+2030.375102108" watchObservedRunningTime="2026-07-28 21:18:45.54106115 +0000 UTC m=+2030.375304738"
Jul 28 21:18:45.558152 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.558090    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg" podStartSLOduration=1.558072273 podStartE2EDuration="1.558072273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:18:45.556127266 +0000 UTC m=+2030.390370854" watchObservedRunningTime="2026-07-28 21:18:45.558072273 +0000 UTC m=+2030.392315859"
Jul 28 21:18:45.574379 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:45.574312    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg" podStartSLOduration=2.068972928 podStartE2EDuration="2.574287383s" totalImagesPullingTime="505.314455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:18:45.572060028 +0000 UTC m=+2030.406303616" watchObservedRunningTime="2026-07-28 21:18:45.574287383 +0000 UTC m=+2030.408530974"
Jul 28 21:18:51.537624 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:51.537595    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:18:56.534383 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:56.534349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:18:56.534940 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:56.534500    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:18:57.524110 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.523210    2572 patch_prober.go:28] interesting pod/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:41106->10.132.0.52:15021: read: connection reset by peer" start-of-body=
Jul 28 21:18:57.524110 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.523275    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:41106->10.132.0.52:15021: read: connection reset by peer"
Jul 28 21:18:57.592235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.592203    2572 generic.go:356] "Generic (PLEG): container finished" podID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerID="190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1" exitCode=0
Jul 28 21:18:57.592621 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.592250    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" event={"ID":"2199e411-c571-4094-b8ed-81c4c5f89ba3","Type":"ContainerDied","Data":"190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1"}
Jul 28 21:18:57.592621 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.592618    2572 scope.go:117] "RemoveContainer" containerID="190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1"
Jul 28 21:18:57.593739 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.593711    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:18:57.593834 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.593815    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:18:57.593880 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:57.593865    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:18:58.604583 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:58.604539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" event={"ID":"2199e411-c571-4094-b8ed-81c4c5f89ba3","Type":"ContainerStarted","Data":"147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6"}
Jul 28 21:18:58.626369 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:58.626333    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:18:58.626553 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:58.626475    2572 patch_prober.go:28] interesting pod/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 21:18:58.626553 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:58.626528    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 21:18:59.626440 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:59.626403    2572 patch_prober.go:28] interesting pod/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 21:18:59.626872 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:18:59.626457    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 21:19:00.626731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:00.626698    2572 patch_prober.go:28] interesting pod/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 21:19:00.627185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:00.626757    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 21:19:01.626966 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:01.626924    2572 patch_prober.go:28] interesting pod/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 28 21:19:01.627383 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:01.626985    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 28 21:19:02.630631 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:02.630599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:19:02.631094 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:02.630932    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:19:02.631884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:02.631863    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:19:08.171565 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:08.171534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:19:09.206024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:09.205989    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:19:14.664409 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:14.664359    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:19:55.786852 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:55.786819    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:19:55.791794 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:55.791745    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:19:58.731178 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.731137    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"]
Jul 28 21:19:58.732130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.732062    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg" podUID="11f67bb7-4d38-4d7c-935f-55285ac2904a" containerName="maas-api" containerID="cri-o://ca2ec167090a7b3f940e81b44356252033e8886a1305c4d0edf950a030377cf1" gracePeriod=30
Jul 28 21:19:58.758498 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.758468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:19:58.789112 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.789063    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"]
Jul 28 21:19:58.789366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.789340    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5" podUID="aa70473e-883a-45d5-bb78-829841001768" containerName="payload-processing" containerID="cri-o://7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db" gracePeriod=30
Jul 28 21:19:58.795720 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.795689    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"]
Jul 28 21:19:58.796215 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.795999    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg" podUID="d19f8a03-4ee8-44f6-ac5d-64726f86c435" containerName="payload-pre-processing" containerID="cri-o://18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52" gracePeriod=30
Jul 28 21:19:58.825189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.825108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:19:58.884308 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.884279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:19:58.901624 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.901592    2572 generic.go:356] "Generic (PLEG): container finished" podID="11f67bb7-4d38-4d7c-935f-55285ac2904a" containerID="ca2ec167090a7b3f940e81b44356252033e8886a1305c4d0edf950a030377cf1" exitCode=0
Jul 28 21:19:58.901810 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.901664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg" event={"ID":"11f67bb7-4d38-4d7c-935f-55285ac2904a","Type":"ContainerDied","Data":"ca2ec167090a7b3f940e81b44356252033e8886a1305c4d0edf950a030377cf1"}
Jul 28 21:19:58.940984 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:58.940907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:19:59.099869 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.099839    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:19:59.103967 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.103938    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:19:59.117343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.117314    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:19:59.144856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.144824    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7z6l\" (UniqueName: \"kubernetes.io/projected/11f67bb7-4d38-4d7c-935f-55285ac2904a-kube-api-access-p7z6l\") pod \"11f67bb7-4d38-4d7c-935f-55285ac2904a\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") "
Jul 28 21:19:59.144856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.144859    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xqd4\" (UniqueName: \"kubernetes.io/projected/aa70473e-883a-45d5-bb78-829841001768-kube-api-access-8xqd4\") pod \"aa70473e-883a-45d5-bb78-829841001768\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") "
Jul 28 21:19:59.145208 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.144885    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa70473e-883a-45d5-bb78-829841001768-plugins-config-volume\") pod \"aa70473e-883a-45d5-bb78-829841001768\" (UID: \"aa70473e-883a-45d5-bb78-829841001768\") "
Jul 28 21:19:59.145208 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.144915    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d19f8a03-4ee8-44f6-ac5d-64726f86c435-plugins-config-volume\") pod \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") "
Jul 28 21:19:59.145208 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.144954    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f67bb7-4d38-4d7c-935f-55285ac2904a-openshift-service-ca\") pod \"11f67bb7-4d38-4d7c-935f-55285ac2904a\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") "
Jul 28 21:19:59.145208 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.144987    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls\") pod \"11f67bb7-4d38-4d7c-935f-55285ac2904a\" (UID: \"11f67bb7-4d38-4d7c-935f-55285ac2904a\") "
Jul 28 21:19:59.145208 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.145019    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5dbh\" (UniqueName: \"kubernetes.io/projected/d19f8a03-4ee8-44f6-ac5d-64726f86c435-kube-api-access-p5dbh\") pod \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\" (UID: \"d19f8a03-4ee8-44f6-ac5d-64726f86c435\") "
Jul 28 21:19:59.145476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.145291    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa70473e-883a-45d5-bb78-829841001768-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa70473e-883a-45d5-bb78-829841001768" (UID: "aa70473e-883a-45d5-bb78-829841001768"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:59.145562 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.145508    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f67bb7-4d38-4d7c-935f-55285ac2904a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11f67bb7-4d38-4d7c-935f-55285ac2904a" (UID: "11f67bb7-4d38-4d7c-935f-55285ac2904a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:59.145562 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.145533    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19f8a03-4ee8-44f6-ac5d-64726f86c435-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d19f8a03-4ee8-44f6-ac5d-64726f86c435" (UID: "d19f8a03-4ee8-44f6-ac5d-64726f86c435"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:59.147341 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.147306    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f67bb7-4d38-4d7c-935f-55285ac2904a-kube-api-access-p7z6l" (OuterVolumeSpecName: "kube-api-access-p7z6l") pod "11f67bb7-4d38-4d7c-935f-55285ac2904a" (UID: "11f67bb7-4d38-4d7c-935f-55285ac2904a"). InnerVolumeSpecName "kube-api-access-p7z6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:59.147840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.147801    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11f67bb7-4d38-4d7c-935f-55285ac2904a" (UID: "11f67bb7-4d38-4d7c-935f-55285ac2904a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:19:59.148038 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.148017    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa70473e-883a-45d5-bb78-829841001768-kube-api-access-8xqd4" (OuterVolumeSpecName: "kube-api-access-8xqd4") pod "aa70473e-883a-45d5-bb78-829841001768" (UID: "aa70473e-883a-45d5-bb78-829841001768"). InnerVolumeSpecName "kube-api-access-8xqd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:59.148117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.148050    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d19f8a03-4ee8-44f6-ac5d-64726f86c435-kube-api-access-p5dbh" (OuterVolumeSpecName: "kube-api-access-p5dbh") pod "d19f8a03-4ee8-44f6-ac5d-64726f86c435" (UID: "d19f8a03-4ee8-44f6-ac5d-64726f86c435"). InnerVolumeSpecName "kube-api-access-p5dbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:59.245862 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.245825    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d19f8a03-4ee8-44f6-ac5d-64726f86c435-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:19:59.245862 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.245860    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f67bb7-4d38-4d7c-935f-55285ac2904a-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:19:59.245862 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.245872    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f67bb7-4d38-4d7c-935f-55285ac2904a-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:19:59.246117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.245882    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5dbh\" (UniqueName: \"kubernetes.io/projected/d19f8a03-4ee8-44f6-ac5d-64726f86c435-kube-api-access-p5dbh\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:19:59.246117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.245894    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7z6l\" (UniqueName: \"kubernetes.io/projected/11f67bb7-4d38-4d7c-935f-55285ac2904a-kube-api-access-p7z6l\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:19:59.246117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.245906    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xqd4\" (UniqueName: \"kubernetes.io/projected/aa70473e-883a-45d5-bb78-829841001768-kube-api-access-8xqd4\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:19:59.246117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.245917    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa70473e-883a-45d5-bb78-829841001768-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:19:59.909067 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.909036    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"
Jul 28 21:19:59.909542 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.909039    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg" event={"ID":"11f67bb7-4d38-4d7c-935f-55285ac2904a","Type":"ContainerDied","Data":"65558f0f59d95ef3bcaa816e3f542b822c8dc4f4a39addd72e0d50d292f4c6e4"}
Jul 28 21:19:59.909542 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.909210    2572 scope.go:117] "RemoveContainer" containerID="ca2ec167090a7b3f940e81b44356252033e8886a1305c4d0edf950a030377cf1"
Jul 28 21:19:59.910655 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.910581    2572 generic.go:356] "Generic (PLEG): container finished" podID="aa70473e-883a-45d5-bb78-829841001768" containerID="7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db" exitCode=0
Jul 28 21:19:59.910735 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.910665    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"
Jul 28 21:19:59.910863 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.910664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5" event={"ID":"aa70473e-883a-45d5-bb78-829841001768","Type":"ContainerDied","Data":"7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db"}
Jul 28 21:19:59.910942 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.910909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5" event={"ID":"aa70473e-883a-45d5-bb78-829841001768","Type":"ContainerDied","Data":"dd9ebcb7aee79da99874c13744a9f3804eb79ab764a1ee764164e91b9b0e3a2a"}
Jul 28 21:19:59.912678 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.912651    2572 generic.go:356] "Generic (PLEG): container finished" podID="d19f8a03-4ee8-44f6-ac5d-64726f86c435" containerID="18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52" exitCode=0
Jul 28 21:19:59.912861 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.912709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg" event={"ID":"d19f8a03-4ee8-44f6-ac5d-64726f86c435","Type":"ContainerDied","Data":"18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52"}
Jul 28 21:19:59.912861 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.912726    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"
Jul 28 21:19:59.912861 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.912751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg" event={"ID":"d19f8a03-4ee8-44f6-ac5d-64726f86c435","Type":"ContainerDied","Data":"121ffabf63724a0b53354543024c0c78ab91cd363950d0f53ca9d09cf1593477"}
Jul 28 21:19:59.920119 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.920099    2572 scope.go:117] "RemoveContainer" containerID="7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db"
Jul 28 21:19:59.929424 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.929397    2572 scope.go:117] "RemoveContainer" containerID="7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db"
Jul 28 21:19:59.930084 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:19:59.929881    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db\": container with ID starting with 7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db not found: ID does not exist" containerID="7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db"
Jul 28 21:19:59.930198 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.930098    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db"} err="failed to get container status \"7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db\": rpc error: code = NotFound desc = could not find container \"7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db\": container with ID starting with 7cd1d44e351aff7acc868f5d8b3140be1c6604734786db109aefcff1077a14db not found: ID does not exist"
Jul 28 21:19:59.930198 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.930126    2572 scope.go:117] "RemoveContainer" containerID="18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52"
Jul 28 21:19:59.932079 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.932057    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"]
Jul 28 21:19:59.936187 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.936163    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5"]
Jul 28 21:19:59.939429 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.939409    2572 scope.go:117] "RemoveContainer" containerID="18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52"
Jul 28 21:19:59.939753 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:19:59.939736    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52\": container with ID starting with 18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52 not found: ID does not exist" containerID="18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52"
Jul 28 21:19:59.939831 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.939760    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52"} err="failed to get container status \"18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52\": rpc error: code = NotFound desc = could not find container \"18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52\": container with ID starting with 18e90b5e3a534aa23fad2492ae9cb585cfb2a8e1c349fee6a31800f96afefc52 not found: ID does not exist"
Jul 28 21:19:59.948686 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.948650    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"]
Jul 28 21:19:59.951016 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.950993    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dd70051-66f47b5c45-mm7rg"]
Jul 28 21:19:59.961089 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.961049    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"]
Jul 28 21:19:59.966841 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:19:59.966811    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg"]
Jul 28 21:20:01.717511 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:01.717480    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f67bb7-4d38-4d7c-935f-55285ac2904a" path="/var/lib/kubelet/pods/11f67bb7-4d38-4d7c-935f-55285ac2904a/volumes"
Jul 28 21:20:01.718004 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:01.717841    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa70473e-883a-45d5-bb78-829841001768" path="/var/lib/kubelet/pods/aa70473e-883a-45d5-bb78-829841001768/volumes"
Jul 28 21:20:01.718151 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:01.718137    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d19f8a03-4ee8-44f6-ac5d-64726f86c435" path="/var/lib/kubelet/pods/d19f8a03-4ee8-44f6-ac5d-64726f86c435/volumes"
Jul 28 21:20:02.289913 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:02.289885    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:07.320358 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:07.320318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:43.502393 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:43.502359    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:44.862190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:44.862149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:50.611886 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:50.611769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:50.672895 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:50.672860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:50.904567 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:50.904528    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"]
Jul 28 21:20:50.904848 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:50.904804    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy" containerID="cri-o://147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6" gracePeriod=30
Jul 28 21:20:50.931631 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:50.931599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:51.166468 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:51.166378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:52.263087 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:52.263042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:52.353145 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:52.353117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:52.454609 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:52.454572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:53.244375 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:53.244336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:53.343235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:53.343194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:53.443038 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:53.443009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:54.917367 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:54.917335    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:20:56.171024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.170945    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:20:56.190939 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.190906    2572 generic.go:356] "Generic (PLEG): container finished" podID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerID="147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6" exitCode=0
Jul 28 21:20:56.191156 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.190963    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"
Jul 28 21:20:56.191156 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.190994    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" event={"ID":"2199e411-c571-4094-b8ed-81c4c5f89ba3","Type":"ContainerDied","Data":"147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6"}
Jul 28 21:20:56.191156 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.191063    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq" event={"ID":"2199e411-c571-4094-b8ed-81c4c5f89ba3","Type":"ContainerDied","Data":"f8dee5e858b5d074559b75787feb8f9ec248743e9dc94d992996b737a01156c1"}
Jul 28 21:20:56.191156 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.191097    2572 scope.go:117] "RemoveContainer" containerID="147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6"
Jul 28 21:20:56.201292 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.201267    2572 scope.go:117] "RemoveContainer" containerID="190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1"
Jul 28 21:20:56.212465 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.212439    2572 scope.go:117] "RemoveContainer" containerID="147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6"
Jul 28 21:20:56.212855 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:20:56.212828    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6\": container with ID starting with 147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6 not found: ID does not exist" containerID="147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6"
Jul 28 21:20:56.212961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.212868    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6"} err="failed to get container status \"147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6\": rpc error: code = NotFound desc = could not find container \"147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6\": container with ID starting with 147ea721a8a9fe67b4188382875fe220d4f243fa347b3f1867fd70037b988ba6 not found: ID does not exist"
Jul 28 21:20:56.212961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.212895    2572 scope.go:117] "RemoveContainer" containerID="190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1"
Jul 28 21:20:56.213203 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:20:56.213184    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1\": container with ID starting with 190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1 not found: ID does not exist" containerID="190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1"
Jul 28 21:20:56.213250 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.213211    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1"} err="failed to get container status \"190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1\": rpc error: code = NotFound desc = could not find container \"190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1\": container with ID starting with 190868dab1708c15ffd85d0aaf3cb65e86c369234a134d9811cd1ee327f5f1b1 not found: ID does not exist"
Jul 28 21:20:56.258667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258637    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-token\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.258667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258680    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2199e411-c571-4094-b8ed-81c4c5f89ba3-istiod-ca-cert\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.258970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258704    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-data\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.258970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258732    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-credential-socket\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.258970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258852    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvlwj\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-kube-api-access-tvlwj\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.258970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258892    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-socket\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.258970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258924    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-certs\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.258970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.258967    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-podinfo\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.259294 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259024    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-envoy\") pod \"2199e411-c571-4094-b8ed-81c4c5f89ba3\" (UID: \"2199e411-c571-4094-b8ed-81c4c5f89ba3\") "
Jul 28 21:20:56.259294 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259165    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:56.259294 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259178    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:56.259294 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259210    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2199e411-c571-4094-b8ed-81c4c5f89ba3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:20:56.259480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259348    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:56.259480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259440    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.259480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259462    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.259480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259474    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2199e411-c571-4094-b8ed-81c4c5f89ba3-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.259692 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259487    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.259692 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.259517    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-data" (OuterVolumeSpecName: "istio-data") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:56.261469 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.261434    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:56.261469 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.261453    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-kube-api-access-tvlwj" (OuterVolumeSpecName: "kube-api-access-tvlwj") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "kube-api-access-tvlwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:20:56.261765 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.261734    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:20:56.261765 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.261738    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-token" (OuterVolumeSpecName: "istio-token") pod "2199e411-c571-4094-b8ed-81c4c5f89ba3" (UID: "2199e411-c571-4094-b8ed-81c4c5f89ba3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:20:56.360141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.360092    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvlwj\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-kube-api-access-tvlwj\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.360141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.360133    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.360141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.360142    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.360141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.360150    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.360426 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.360158    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2199e411-c571-4094-b8ed-81c4c5f89ba3-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:20:56.514087 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.514050    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"]
Jul 28 21:20:56.521655 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:56.521612    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq"]
Jul 28 21:20:57.717178 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:20:57.717140    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" path="/var/lib/kubelet/pods/2199e411-c571-4094-b8ed-81c4c5f89ba3/volumes"
Jul 28 21:21:01.051067 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:01.051033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:01.115492 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:01.115456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:01.732225 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:01.732197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:08.592130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:08.592087    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:08.695438 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:08.695401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:08.793194 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:08.793142    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:19.339432 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:19.339394    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:19.703161 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:19.703130    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:40.672307 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:40.672268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:47.666126 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:47.666090    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:47.766579 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:47.766538    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:48.040552 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.040463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:48.368854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.368751    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"]
Jul 28 21:21:48.369140 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369126    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d19f8a03-4ee8-44f6-ac5d-64726f86c435" containerName="payload-pre-processing"
Jul 28 21:21:48.369183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369142    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d19f8a03-4ee8-44f6-ac5d-64726f86c435" containerName="payload-pre-processing"
Jul 28 21:21:48.369183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369151    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy"
Jul 28 21:21:48.369183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369157    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy"
Jul 28 21:21:48.369183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369171    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f67bb7-4d38-4d7c-935f-55285ac2904a" containerName="maas-api"
Jul 28 21:21:48.369183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369176    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f67bb7-4d38-4d7c-935f-55285ac2904a" containerName="maas-api"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369185    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa70473e-883a-45d5-bb78-829841001768" containerName="payload-processing"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369192    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa70473e-883a-45d5-bb78-829841001768" containerName="payload-processing"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369200    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369206    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369281    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369291    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa70473e-883a-45d5-bb78-829841001768" containerName="payload-processing"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369298    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2199e411-c571-4094-b8ed-81c4c5f89ba3" containerName="istio-proxy"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369304    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d19f8a03-4ee8-44f6-ac5d-64726f86c435" containerName="payload-pre-processing"
Jul 28 21:21:48.369372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.369311    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f67bb7-4d38-4d7c-935f-55285ac2904a" containerName="maas-api"
Jul 28 21:21:48.372501 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.372481    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.374998 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.374972    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d9fd50-openshift-default-dockercfg-xm89q\""
Jul 28 21:21:48.385052 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.385027    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"]
Jul 28 21:21:48.395400 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.395375    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:48.421890 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.421844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-token\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.421911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-certs\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.421940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-envoy\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.421982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-credential-socket\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.422043    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-data\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422241 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.422090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-podinfo\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422241 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.422126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcz5f\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-kube-api-access-bcz5f\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422241 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.422171    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istiod-ca-cert\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.422241 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.422192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-socket\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.519639 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.519604    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:48.522815 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.522740    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-token\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.522933 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.522842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-certs\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.522933 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.522865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-envoy\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.522933 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.522898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-credential-socket\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.522933 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.522925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-data\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.522951    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-podinfo\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.522988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcz5f\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-kube-api-access-bcz5f\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.523036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istiod-ca-cert\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.523065    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-socket\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523504 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.523480    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-socket\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.523620    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-credential-socket\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523709 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.523541    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-certs\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523709 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.523557    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-data\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.523948 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.523929    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istiod-ca-cert\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.525618 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.525598    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-envoy\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.525719 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.525700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-podinfo\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.530685 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.530656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-token\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.530819 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.530760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcz5f\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-kube-api-access-bcz5f\") pod \"e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") " pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.683201 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.683165    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:48.820146 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.820121    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"]
Jul 28 21:21:48.822481 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:21:48.822441    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b2104e_e783_45c3_9a2f_4e04eaa055ba.slice/crio-b5b98671b78bf48b48105d52cf3dae1c94496b92326c528f40ab829054deac69 WatchSource:0}: Error finding container b5b98671b78bf48b48105d52cf3dae1c94496b92326c528f40ab829054deac69: Status 404 returned error can't find the container with id b5b98671b78bf48b48105d52cf3dae1c94496b92326c528f40ab829054deac69
Jul 28 21:21:48.824501 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.824467    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:21:48.824604 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.824537    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:21:48.824604 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:48.824564    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:21:49.453703 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:49.453662    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" event={"ID":"69b2104e-e783-45c3-9a2f-4e04eaa055ba","Type":"ContainerStarted","Data":"56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0"}
Jul 28 21:21:49.453975 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:49.453717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" event={"ID":"69b2104e-e783-45c3-9a2f-4e04eaa055ba","Type":"ContainerStarted","Data":"b5b98671b78bf48b48105d52cf3dae1c94496b92326c528f40ab829054deac69"}
Jul 28 21:21:49.476210 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:49.476160    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" podStartSLOduration=1.476143937 podStartE2EDuration="1.476143937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:21:49.474719315 +0000 UTC m=+2214.308962905" watchObservedRunningTime="2026-07-28 21:21:49.476143937 +0000 UTC m=+2214.310387520"
Jul 28 21:21:49.683611 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:49.683583    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:49.688525 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:49.688501    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:50.458978 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:50.458949    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:50.460083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:50.460057    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:21:51.423717 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.423665    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:51.523242 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.523209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:51.644692 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.644658    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"]
Jul 28 21:21:51.648714 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.648693    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.652966 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.652943    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d9fd50-serving-cert\""
Jul 28 21:21:51.659469 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.659448    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"]
Jul 28 21:21:51.681677 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.681601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:51.751372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.751340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8qq\" (UniqueName: \"kubernetes.io/projected/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-kube-api-access-mz8qq\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.751589 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.751490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.751589 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.751534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.859124 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.853210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.859124 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.853296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.859124 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.853364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8qq\" (UniqueName: \"kubernetes.io/projected/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-kube-api-access-mz8qq\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.859124 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.854611    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:51.859124 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:21:51.854737    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-serving-cert: secret "maas-api-e2e-inf-a-d9fd50-serving-cert" not found
Jul 28 21:21:51.859124 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:21:51.854832    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls podName:fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2 nodeName:}" failed. No retries permitted until 2026-07-28 21:21:52.354812824 +0000 UTC m=+2217.189056403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls") pod "maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs" (UID: "fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2") : secret "maas-api-e2e-inf-a-d9fd50-serving-cert" not found
Jul 28 21:21:51.866648 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:51.866610    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8qq\" (UniqueName: \"kubernetes.io/projected/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-kube-api-access-mz8qq\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:52.216165 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.216130    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:52.318395 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.318364    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:52.358813 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.358761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:52.361282 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.361255    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:52.379728 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.379703    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"]
Jul 28 21:21:52.383248 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.383233    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.385835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.385813    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-d9fd50-dockercfg-jkjjv\""
Jul 28 21:21:52.385835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.385820    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d9fd50\""
Jul 28 21:21:52.393473 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.393451    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"]
Jul 28 21:21:52.396497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.396472    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:21:52.404852 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.404830    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"]
Jul 28 21:21:52.408103 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.408081    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.419541 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.419514    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"]
Jul 28 21:21:52.459894 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.459857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4ph5\" (UniqueName: \"kubernetes.io/projected/986391f4-ed73-41a5-bf89-4bb631faa59f-kube-api-access-m4ph5\") pod \"payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.460323 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.459927    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/986391f4-ed73-41a5-bf89-4bb631faa59f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.460323 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.459980    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.460323 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.460012    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j4sh\" (UniqueName: \"kubernetes.io/projected/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-kube-api-access-4j4sh\") pod \"payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.561043 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.560946    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:52.561270 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.561249    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4ph5\" (UniqueName: \"kubernetes.io/projected/986391f4-ed73-41a5-bf89-4bb631faa59f-kube-api-access-m4ph5\") pod \"payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.561356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.561313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/986391f4-ed73-41a5-bf89-4bb631faa59f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.561415 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.561396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.561476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.561428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j4sh\" (UniqueName: \"kubernetes.io/projected/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-kube-api-access-4j4sh\") pod \"payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.562044 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.562024    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/986391f4-ed73-41a5-bf89-4bb631faa59f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.562214 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.562192    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.569730 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.569696    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j4sh\" (UniqueName: \"kubernetes.io/projected/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-kube-api-access-4j4sh\") pod \"payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.569895 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.569876    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4ph5\" (UniqueName: \"kubernetes.io/projected/986391f4-ed73-41a5-bf89-4bb631faa59f-kube-api-access-m4ph5\") pod \"payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.694542 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.694498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:52.713158 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.713125    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"]
Jul 28 21:21:52.715464 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:21:52.715438    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1bb2ed_cb8e_4d1d_8db7_8db56d35b6c2.slice/crio-59424e02ad9c620f13e14287f9326bb213aa0ca709efcc503c1ca3aeda827136 WatchSource:0}: Error finding container 59424e02ad9c620f13e14287f9326bb213aa0ca709efcc503c1ca3aeda827136: Status 404 returned error can't find the container with id 59424e02ad9c620f13e14287f9326bb213aa0ca709efcc503c1ca3aeda827136
Jul 28 21:21:52.719872 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.719849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:52.853754 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.853727    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"]
Jul 28 21:21:52.857132 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:21:52.857103    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2743c4eb_e887_4ced_ab7b_eb5ddb8d0f81.slice/crio-34c6d4bebd75e981325a33798eb9cd98a78c48e0cc437bce591535023781d245 WatchSource:0}: Error finding container 34c6d4bebd75e981325a33798eb9cd98a78c48e0cc437bce591535023781d245: Status 404 returned error can't find the container with id 34c6d4bebd75e981325a33798eb9cd98a78c48e0cc437bce591535023781d245
Jul 28 21:21:52.880663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:52.880637    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"]
Jul 28 21:21:52.883959 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:21:52.883930    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986391f4_ed73_41a5_bf89_4bb631faa59f.slice/crio-3ca8bd5456a54347dc81b33c88a29b3ef2be1b6fbfc8f314b8ec15a50e1f6742 WatchSource:0}: Error finding container 3ca8bd5456a54347dc81b33c88a29b3ef2be1b6fbfc8f314b8ec15a50e1f6742: Status 404 returned error can't find the container with id 3ca8bd5456a54347dc81b33c88a29b3ef2be1b6fbfc8f314b8ec15a50e1f6742
Jul 28 21:21:53.474605 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.474509    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb" event={"ID":"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81","Type":"ContainerStarted","Data":"5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5"}
Jul 28 21:21:53.475092 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.474836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb" event={"ID":"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81","Type":"ContainerStarted","Data":"34c6d4bebd75e981325a33798eb9cd98a78c48e0cc437bce591535023781d245"}
Jul 28 21:21:53.475092 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.474879    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:21:53.476290 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.476262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx" event={"ID":"986391f4-ed73-41a5-bf89-4bb631faa59f","Type":"ContainerStarted","Data":"15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be"}
Jul 28 21:21:53.476425 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.476314    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx" event={"ID":"986391f4-ed73-41a5-bf89-4bb631faa59f","Type":"ContainerStarted","Data":"3ca8bd5456a54347dc81b33c88a29b3ef2be1b6fbfc8f314b8ec15a50e1f6742"}
Jul 28 21:21:53.476425 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.476343    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:21:53.477972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.477954    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs" event={"ID":"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2","Type":"ContainerStarted","Data":"26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d"}
Jul 28 21:21:53.478080 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.477989    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs" event={"ID":"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2","Type":"ContainerStarted","Data":"59424e02ad9c620f13e14287f9326bb213aa0ca709efcc503c1ca3aeda827136"}
Jul 28 21:21:53.478136 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.478112    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:21:53.492282 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.492234    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb" podStartSLOduration=1.492220104 podStartE2EDuration="1.492220104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:21:53.491363267 +0000 UTC m=+2218.325606853" watchObservedRunningTime="2026-07-28 21:21:53.492220104 +0000 UTC m=+2218.326463691"
Jul 28 21:21:53.514942 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.514738    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs" podStartSLOduration=2.085162923 podStartE2EDuration="2.514720971s" totalImagesPullingTime="429.558048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:21:53.514243744 +0000 UTC m=+2218.348487331" watchObservedRunningTime="2026-07-28 21:21:53.514720971 +0000 UTC m=+2218.348964558"
Jul 28 21:21:53.530345 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:53.530295    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx" podStartSLOduration=1.530278104 podStartE2EDuration="1.530278104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:21:53.529927404 +0000 UTC m=+2218.364171004" watchObservedRunningTime="2026-07-28 21:21:53.530278104 +0000 UTC m=+2218.364521693"
Jul 28 21:21:59.498214 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:21:59.498172    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:22:03.534074 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:03.534042    2572 generic.go:356] "Generic (PLEG): container finished" podID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerID="56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0" exitCode=0
Jul 28 21:22:03.534514 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:03.534121    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" event={"ID":"69b2104e-e783-45c3-9a2f-4e04eaa055ba","Type":"ContainerDied","Data":"56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0"}
Jul 28 21:22:03.534568 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:03.534524    2572 scope.go:117] "RemoveContainer" containerID="56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0"
Jul 28 21:22:03.535604 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:03.535575    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:03.535712 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:03.535658    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:03.535712 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:03.535704    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:04.487981 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:04.487934    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:22:04.489371 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:04.489340    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:22:04.543685 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:04.543653    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" event={"ID":"69b2104e-e783-45c3-9a2f-4e04eaa055ba","Type":"ContainerStarted","Data":"2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2"}
Jul 28 21:22:04.683553 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:04.683511    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:22:04.685281 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:04.685245    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 28 21:22:04.685437 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:04.685331    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 28 21:22:05.459225 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:05.459191    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:22:05.684081 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:05.684035    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 28 21:22:05.684715 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:05.684115    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 28 21:22:06.684153 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:06.684113    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 28 21:22:06.684811 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:06.684754    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 28 21:22:07.684532 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:07.684479    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 28 21:22:07.685122 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:07.684569    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 28 21:22:08.687435 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:08.687404    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:22:08.688469 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:08.688451    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:22:16.487060 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:16.486954    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:16.841180 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:16.841092    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:17.389495 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.389454    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"]
Jul 28 21:22:17.393237 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.393215    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.401580 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.401561    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9bf2ee-openshift-default-dockercfg-2zwnt\""
Jul 28 21:22:17.443316 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.443280    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:17.481871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.481841    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"]
Jul 28 21:22:17.516921 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.516885    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-data\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.516933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-podinfo\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.516982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357bca7a-60c3-4a80-876f-ed626c4ca455-istiod-ca-cert\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.517037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-certs\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.517084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-token\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.517111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx228\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-kube-api-access-tx228\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.517150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-socket\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.517199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-envoy\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.517343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.517217    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-credential-socket\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.554989 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.554954    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:17.617714 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-podinfo\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.617714 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357bca7a-60c3-4a80-876f-ed626c4ca455-istiod-ca-cert\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-certs\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617802    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-token\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx228\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-kube-api-access-tx228\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-socket\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617904    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-envoy\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-credential-socket\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618017 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.617969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-data\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618416 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.618367    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-socket\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618416 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.618408    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-data\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.618391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-certs\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.618467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-credential-socket\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.618735 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.618716    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357bca7a-60c3-4a80-876f-ed626c4ca455-istiod-ca-cert\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.620311 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.620288    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-envoy\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.620473 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.620452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-podinfo\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.629527 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.629504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-token\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.630130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.630111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx228\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-kube-api-access-tx228\") pod \"e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") " pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.703352 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.703287    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:17.848865 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.848827    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"]
Jul 28 21:22:17.850654 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:22:17.850629    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357bca7a_60c3_4a80_876f_ed626c4ca455.slice/crio-c73a89f5889b94671f6b18072b6c88a4c43bf71f0f630b7a55665e160e179d85 WatchSource:0}: Error finding container c73a89f5889b94671f6b18072b6c88a4c43bf71f0f630b7a55665e160e179d85: Status 404 returned error can't find the container with id c73a89f5889b94671f6b18072b6c88a4c43bf71f0f630b7a55665e160e179d85
Jul 28 21:22:17.852904 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.852873    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:17.852978 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.852937    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:17.852978 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:17.852964    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:18.615416 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:18.615377    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" event={"ID":"357bca7a-60c3-4a80-876f-ed626c4ca455","Type":"ContainerStarted","Data":"b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843"}
Jul 28 21:22:18.615897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:18.615440    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" event={"ID":"357bca7a-60c3-4a80-876f-ed626c4ca455","Type":"ContainerStarted","Data":"c73a89f5889b94671f6b18072b6c88a4c43bf71f0f630b7a55665e160e179d85"}
Jul 28 21:22:18.638461 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:18.638404    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" podStartSLOduration=1.638387393 podStartE2EDuration="1.638387393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:22:18.637080364 +0000 UTC m=+2243.471323991" watchObservedRunningTime="2026-07-28 21:22:18.638387393 +0000 UTC m=+2243.472630979"
Jul 28 21:22:18.704311 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:18.704279    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:18.709826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:18.709800    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:19.620170 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:19.620141    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:19.621027 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:19.621011    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:20.601451 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.601393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:20.678329 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.678284    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"]
Jul 28 21:22:20.682203 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.682178    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.687183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.687157    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-9bf2ee-serving-cert\""
Jul 28 21:22:20.694441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.694407    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"]
Jul 28 21:22:20.694920 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.694877    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:20.747133 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.747099    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/43741752-6fc9-47f7-817e-0ffe1d078db9-kube-api-access-tbtp4\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.747337 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.747228    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.747337 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.747258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43741752-6fc9-47f7-817e-0ffe1d078db9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.774635 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.774601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:20.848418 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.848382    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/43741752-6fc9-47f7-817e-0ffe1d078db9-kube-api-access-tbtp4\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.848632 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.848495    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.848632 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.848532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43741752-6fc9-47f7-817e-0ffe1d078db9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.848731 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:22:20.848626    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-serving-cert: secret "maas-api-e2e-inf-b-9bf2ee-serving-cert" not found
Jul 28 21:22:20.848731 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:22:20.848720    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls podName:43741752-6fc9-47f7-817e-0ffe1d078db9 nodeName:}" failed. No retries permitted until 2026-07-28 21:22:21.348698266 +0000 UTC m=+2246.182941833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls") pod "maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms" (UID: "43741752-6fc9-47f7-817e-0ffe1d078db9") : secret "maas-api-e2e-inf-b-9bf2ee-serving-cert" not found
Jul 28 21:22:20.849272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.849252    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43741752-6fc9-47f7-817e-0ffe1d078db9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.857233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.857163    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/43741752-6fc9-47f7-817e-0ffe1d078db9-kube-api-access-tbtp4\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:20.912544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:20.912514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:21.351972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:21.351931    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:21.354578 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:21.354543    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls\") pod \"maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:21.386641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:21.386606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:21.519517 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:21.519482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:21.593957 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:21.593924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:21.758332 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:21.758308    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"]
Jul 28 21:22:21.760289 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:22:21.760263    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43741752_6fc9_47f7_817e_0ffe1d078db9.slice/crio-616e49ed45268bdaa07bcc8c74101526f94096f1f04f28f2b4a73b92b991b1c4 WatchSource:0}: Error finding container 616e49ed45268bdaa07bcc8c74101526f94096f1f04f28f2b4a73b92b991b1c4: Status 404 returned error can't find the container with id 616e49ed45268bdaa07bcc8c74101526f94096f1f04f28f2b4a73b92b991b1c4
Jul 28 21:22:22.637760 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:22.637725    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms" event={"ID":"43741752-6fc9-47f7-817e-0ffe1d078db9","Type":"ContainerStarted","Data":"b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104"}
Jul 28 21:22:22.637992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:22.637912    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:22.637992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:22.637949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms" event={"ID":"43741752-6fc9-47f7-817e-0ffe1d078db9","Type":"ContainerStarted","Data":"616e49ed45268bdaa07bcc8c74101526f94096f1f04f28f2b4a73b92b991b1c4"}
Jul 28 21:22:22.654460 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:22.654404    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms" podStartSLOduration=2.258553557 podStartE2EDuration="2.654388132s" totalImagesPullingTime="395.834575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:22:22.652930258 +0000 UTC m=+2247.487173855" watchObservedRunningTime="2026-07-28 21:22:22.654388132 +0000 UTC m=+2247.488631717"
Jul 28 21:22:28.649918 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:28.649886    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:22:35.661986 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:35.661940    2572 patch_prober.go:28] interesting pod/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 21:22:35.662402 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:35.662004    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 21:22:36.726751 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:36.726716    2572 generic.go:356] "Generic (PLEG): container finished" podID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerID="b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843" exitCode=0
Jul 28 21:22:36.727252 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:36.726804    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" event={"ID":"357bca7a-60c3-4a80-876f-ed626c4ca455","Type":"ContainerDied","Data":"b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843"}
Jul 28 21:22:36.727252 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:36.727203    2572 scope.go:117] "RemoveContainer" containerID="b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843"
Jul 28 21:22:36.728291 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:36.728262    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:36.728408 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:36.728343    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:36.728408 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:36.728391    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:22:37.740746 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:37.740711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" event={"ID":"357bca7a-60c3-4a80-876f-ed626c4ca455","Type":"ContainerStarted","Data":"6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9"}
Jul 28 21:22:38.703664 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:38.703627    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:38.703898 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:38.703875    2572 patch_prober.go:28] interesting pod/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 21:22:38.703972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:38.703942    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 21:22:39.704249 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:39.704213    2572 patch_prober.go:28] interesting pod/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 21:22:39.704691 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:39.704272    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 21:22:40.703950 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:40.703909    2572 patch_prober.go:28] interesting pod/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 21:22:40.704165 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:40.703983    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 21:22:41.704372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:41.704330    2572 patch_prober.go:28] interesting pod/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 21:22:41.704928 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:41.704409    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 21:22:42.707741 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:42.707701    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:42.708246 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:42.708109    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:42.708837 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:42.708823    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:22:45.628224 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:45.628187    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:22:55.068273 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:22:55.068233    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:23:13.227080 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:23:13.227042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:23:17.386004 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:23:17.385963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:23:50.396414 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:23:50.396324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:23:50.451454 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:23:50.451413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:23:51.672068 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:23:51.672033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:05.781411 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:05.781380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:06.802306 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:06.802268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:17.526389 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.526354    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"]
Jul 28 21:24:17.526862 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.526557    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs" podUID="fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" containerName="maas-api" containerID="cri-o://26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d" gracePeriod=30
Jul 28 21:24:17.559764 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.559729    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:17.593936 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.593899    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"]
Jul 28 21:24:17.594190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.594157    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx" podUID="986391f4-ed73-41a5-bf89-4bb631faa59f" containerName="payload-processing" containerID="cri-o://15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be" gracePeriod=30
Jul 28 21:24:17.598566 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.598530    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"]
Jul 28 21:24:17.598859 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.598767    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb" podUID="2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" containerName="payload-pre-processing" containerID="cri-o://5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5" gracePeriod=30
Jul 28 21:24:17.877536 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.877503    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:24:17.924379 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.924353    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:24:17.931721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.931691    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-openshift-service-ca\") pod \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") "
Jul 28 21:24:17.931918 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.931815    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls\") pod \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") "
Jul 28 21:24:17.931988 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.931947    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz8qq\" (UniqueName: \"kubernetes.io/projected/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-kube-api-access-mz8qq\") pod \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\" (UID: \"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2\") "
Jul 28 21:24:17.932054 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.932030    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" (UID: "fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:24:17.932238 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.932219    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:17.934078 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.934055    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-kube-api-access-mz8qq" (OuterVolumeSpecName: "kube-api-access-mz8qq") pod "fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" (UID: "fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2"). InnerVolumeSpecName "kube-api-access-mz8qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:17.934362 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.934342    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" (UID: "fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:24:17.939852 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:17.939832    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:24:18.033206 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033112    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/986391f4-ed73-41a5-bf89-4bb631faa59f-plugins-config-volume\") pod \"986391f4-ed73-41a5-bf89-4bb631faa59f\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") "
Jul 28 21:24:18.033206 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033169    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4ph5\" (UniqueName: \"kubernetes.io/projected/986391f4-ed73-41a5-bf89-4bb631faa59f-kube-api-access-m4ph5\") pod \"986391f4-ed73-41a5-bf89-4bb631faa59f\" (UID: \"986391f4-ed73-41a5-bf89-4bb631faa59f\") "
Jul 28 21:24:18.033206 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033203    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-plugins-config-volume\") pod \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") "
Jul 28 21:24:18.033434 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033219    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j4sh\" (UniqueName: \"kubernetes.io/projected/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-kube-api-access-4j4sh\") pod \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\" (UID: \"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81\") "
Jul 28 21:24:18.033502 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033483    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz8qq\" (UniqueName: \"kubernetes.io/projected/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-kube-api-access-mz8qq\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:18.033539 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033511    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:18.033621 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033584    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986391f4-ed73-41a5-bf89-4bb631faa59f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "986391f4-ed73-41a5-bf89-4bb631faa59f" (UID: "986391f4-ed73-41a5-bf89-4bb631faa59f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:24:18.033744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.033593    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" (UID: "2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:24:18.035472 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.035447    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986391f4-ed73-41a5-bf89-4bb631faa59f-kube-api-access-m4ph5" (OuterVolumeSpecName: "kube-api-access-m4ph5") pod "986391f4-ed73-41a5-bf89-4bb631faa59f" (UID: "986391f4-ed73-41a5-bf89-4bb631faa59f"). InnerVolumeSpecName "kube-api-access-m4ph5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:18.035557 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.035473    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-kube-api-access-4j4sh" (OuterVolumeSpecName: "kube-api-access-4j4sh") pod "2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" (UID: "2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81"). InnerVolumeSpecName "kube-api-access-4j4sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:18.134652 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.134619    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/986391f4-ed73-41a5-bf89-4bb631faa59f-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:18.134652 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.134650    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4ph5\" (UniqueName: \"kubernetes.io/projected/986391f4-ed73-41a5-bf89-4bb631faa59f-kube-api-access-m4ph5\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:18.134652 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.134661    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:18.134917 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.134670    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j4sh\" (UniqueName: \"kubernetes.io/projected/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81-kube-api-access-4j4sh\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:18.252618 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.252583    2572 generic.go:356] "Generic (PLEG): container finished" podID="fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" containerID="26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d" exitCode=0
Jul 28 21:24:18.252827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.252655    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"
Jul 28 21:24:18.252827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.252673    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs" event={"ID":"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2","Type":"ContainerDied","Data":"26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d"}
Jul 28 21:24:18.252827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.252754    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs" event={"ID":"fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2","Type":"ContainerDied","Data":"59424e02ad9c620f13e14287f9326bb213aa0ca709efcc503c1ca3aeda827136"}
Jul 28 21:24:18.252827 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.252804    2572 scope.go:117] "RemoveContainer" containerID="26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d"
Jul 28 21:24:18.254303 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.254279    2572 generic.go:356] "Generic (PLEG): container finished" podID="2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" containerID="5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5" exitCode=0
Jul 28 21:24:18.254379 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.254352    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"
Jul 28 21:24:18.254433 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.254367    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb" event={"ID":"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81","Type":"ContainerDied","Data":"5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5"}
Jul 28 21:24:18.254433 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.254421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb" event={"ID":"2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81","Type":"ContainerDied","Data":"34c6d4bebd75e981325a33798eb9cd98a78c48e0cc437bce591535023781d245"}
Jul 28 21:24:18.256045 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.256018    2572 generic.go:356] "Generic (PLEG): container finished" podID="986391f4-ed73-41a5-bf89-4bb631faa59f" containerID="15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be" exitCode=0
Jul 28 21:24:18.256190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.256052    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx" event={"ID":"986391f4-ed73-41a5-bf89-4bb631faa59f","Type":"ContainerDied","Data":"15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be"}
Jul 28 21:24:18.256190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.256087    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"
Jul 28 21:24:18.256190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.256134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx" event={"ID":"986391f4-ed73-41a5-bf89-4bb631faa59f","Type":"ContainerDied","Data":"3ca8bd5456a54347dc81b33c88a29b3ef2be1b6fbfc8f314b8ec15a50e1f6742"}
Jul 28 21:24:18.264182 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.264157    2572 scope.go:117] "RemoveContainer" containerID="26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d"
Jul 28 21:24:18.264522 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:18.264502    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d\": container with ID starting with 26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d not found: ID does not exist" containerID="26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d"
Jul 28 21:24:18.264603 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.264531    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d"} err="failed to get container status \"26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d\": rpc error: code = NotFound desc = could not find container \"26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d\": container with ID starting with 26390d2a81a2f6d959207e21311b188c9eb6165be16f9477384967447bd8360d not found: ID does not exist"
Jul 28 21:24:18.264603 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.264549    2572 scope.go:117] "RemoveContainer" containerID="5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5"
Jul 28 21:24:18.273343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.273321    2572 scope.go:117] "RemoveContainer" containerID="5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5"
Jul 28 21:24:18.273643 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:18.273624    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5\": container with ID starting with 5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5 not found: ID does not exist" containerID="5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5"
Jul 28 21:24:18.273700 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.273653    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5"} err="failed to get container status \"5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5\": rpc error: code = NotFound desc = could not find container \"5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5\": container with ID starting with 5913af0fd842638ce07a9619c0667ff5ba069b750cf06a485311086176beb3d5 not found: ID does not exist"
Jul 28 21:24:18.273700 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.273673    2572 scope.go:117] "RemoveContainer" containerID="15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be"
Jul 28 21:24:18.280480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.280449    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"]
Jul 28 21:24:18.283071 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.283052    2572 scope.go:117] "RemoveContainer" containerID="15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be"
Jul 28 21:24:18.283418 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:18.283372    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be\": container with ID starting with 15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be not found: ID does not exist" containerID="15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be"
Jul 28 21:24:18.283468 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.283407    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be"} err="failed to get container status \"15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be\": rpc error: code = NotFound desc = could not find container \"15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be\": container with ID starting with 15efed973b47e7543bd29090899082d8aa607247523270b6d0517c0bf24ca5be not found: ID does not exist"
Jul 28 21:24:18.284116 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.284099    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9fd50-869fd66fb-djzjs"]
Jul 28 21:24:18.294578 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.294556    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"]
Jul 28 21:24:18.298727 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.298701    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb"]
Jul 28 21:24:18.308699 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.308672    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"]
Jul 28 21:24:18.310420 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:18.310399    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx"]
Jul 28 21:24:19.083160 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:19.083125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:19.718471 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:19.718436    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" path="/var/lib/kubelet/pods/2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81/volumes"
Jul 28 21:24:19.718871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:19.718857    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986391f4-ed73-41a5-bf89-4bb631faa59f" path="/var/lib/kubelet/pods/986391f4-ed73-41a5-bf89-4bb631faa59f/volumes"
Jul 28 21:24:19.719212 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:19.719200    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" path="/var/lib/kubelet/pods/fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2/volumes"
Jul 28 21:24:24.802565 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:24.802531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:24.880738 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:24.880700    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"]
Jul 28 21:24:24.881069 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:24.881039    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy" containerID="cri-o://2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2" gracePeriod=30
Jul 28 21:24:24.883163 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:24.883136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:24.967887 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:24.967852    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:25.151125 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:25.151095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:30.146555 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.146490    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:24:30.241978 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.241936    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-data\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.241998    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-certs\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242053    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-socket\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242097    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcz5f\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-kube-api-access-bcz5f\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-credential-socket\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242151    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-token\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242445 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242189    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-podinfo\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242445 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242222    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istiod-ca-cert\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242445 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242254    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-envoy\") pod \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\" (UID: \"69b2104e-e783-45c3-9a2f-4e04eaa055ba\") "
Jul 28 21:24:30.242445 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:30.242650 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242472    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:30.242650 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242487    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:30.242650 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242643    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.242842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242660    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.242842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242673    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.242842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242718    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:24:30.243003 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.242854    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:30.244657 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.244630    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:30.244811 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.244706    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:24:30.244911 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.244893    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-kube-api-access-bcz5f" (OuterVolumeSpecName: "kube-api-access-bcz5f") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "kube-api-access-bcz5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:30.244959 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.244939    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "69b2104e-e783-45c3-9a2f-4e04eaa055ba" (UID: "69b2104e-e783-45c3-9a2f-4e04eaa055ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:30.328621 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.328585    2572 generic.go:356] "Generic (PLEG): container finished" podID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerID="2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2" exitCode=0
Jul 28 21:24:30.328931 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.328650    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"
Jul 28 21:24:30.328931 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.328676    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" event={"ID":"69b2104e-e783-45c3-9a2f-4e04eaa055ba","Type":"ContainerDied","Data":"2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2"}
Jul 28 21:24:30.328931 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.328848    2572 scope.go:117] "RemoveContainer" containerID="2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2"
Jul 28 21:24:30.328931 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.328770    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b" event={"ID":"69b2104e-e783-45c3-9a2f-4e04eaa055ba","Type":"ContainerDied","Data":"b5b98671b78bf48b48105d52cf3dae1c94496b92326c528f40ab829054deac69"}
Jul 28 21:24:30.339102 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.339082    2572 scope.go:117] "RemoveContainer" containerID="56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0"
Jul 28 21:24:30.343637 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.343610    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.343732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.343644    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcz5f\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-kube-api-access-bcz5f\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.343732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.343663    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.343732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.343681    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.343732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.343695    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.343732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.343708    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69b2104e-e783-45c3-9a2f-4e04eaa055ba-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:30.347939 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.347923    2572 scope.go:117] "RemoveContainer" containerID="2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2"
Jul 28 21:24:30.348217 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:30.348200    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2\": container with ID starting with 2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2 not found: ID does not exist" containerID="2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2"
Jul 28 21:24:30.348260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.348225    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2"} err="failed to get container status \"2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2\": rpc error: code = NotFound desc = could not find container \"2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2\": container with ID starting with 2d81e672879f5cc0824fb8b1d5b8d6d00913227ad0392b421eb7dc98a3fb9ce2 not found: ID does not exist"
Jul 28 21:24:30.348260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.348241    2572 scope.go:117] "RemoveContainer" containerID="56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0"
Jul 28 21:24:30.348480 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:30.348461    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0\": container with ID starting with 56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0 not found: ID does not exist" containerID="56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0"
Jul 28 21:24:30.348522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.348489    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0"} err="failed to get container status \"56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0\": rpc error: code = NotFound desc = could not find container \"56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0\": container with ID starting with 56473ac2dd5de7c2b4106afd015225752486e1a7d284a735a84129a99a1623d0 not found: ID does not exist"
Jul 28 21:24:30.362222 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.362196    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"]
Jul 28 21:24:30.367303 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:30.367274    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b"]
Jul 28 21:24:31.717221 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:31.717192    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" path="/var/lib/kubelet/pods/69b2104e-e783-45c3-9a2f-4e04eaa055ba/volumes"
Jul 28 21:24:35.720107 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:35.720069    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"]
Jul 28 21:24:35.720584 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:35.720297    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms" podUID="43741752-6fc9-47f7-817e-0ffe1d078db9" containerName="maas-api" containerID="cri-o://b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104" gracePeriod=30
Jul 28 21:24:35.743509 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:35.743480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:35.843119 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:35.843081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:35.914078 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:35.914047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:35.969479 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:35.969448    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:35.990059 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:35.990034    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:24:36.092848 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.092805    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls\") pod \"43741752-6fc9-47f7-817e-0ffe1d078db9\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") "
Jul 28 21:24:36.093026 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.092868    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43741752-6fc9-47f7-817e-0ffe1d078db9-openshift-service-ca\") pod \"43741752-6fc9-47f7-817e-0ffe1d078db9\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") "
Jul 28 21:24:36.093026 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.092928    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/43741752-6fc9-47f7-817e-0ffe1d078db9-kube-api-access-tbtp4\") pod \"43741752-6fc9-47f7-817e-0ffe1d078db9\" (UID: \"43741752-6fc9-47f7-817e-0ffe1d078db9\") "
Jul 28 21:24:36.093213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.093191    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43741752-6fc9-47f7-817e-0ffe1d078db9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "43741752-6fc9-47f7-817e-0ffe1d078db9" (UID: "43741752-6fc9-47f7-817e-0ffe1d078db9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:24:36.093306 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.093289    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43741752-6fc9-47f7-817e-0ffe1d078db9-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:36.095205 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.095170    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43741752-6fc9-47f7-817e-0ffe1d078db9-kube-api-access-tbtp4" (OuterVolumeSpecName: "kube-api-access-tbtp4") pod "43741752-6fc9-47f7-817e-0ffe1d078db9" (UID: "43741752-6fc9-47f7-817e-0ffe1d078db9"). InnerVolumeSpecName "kube-api-access-tbtp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:36.095205 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.095199    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "43741752-6fc9-47f7-817e-0ffe1d078db9" (UID: "43741752-6fc9-47f7-817e-0ffe1d078db9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:24:36.194699 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.194666    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43741752-6fc9-47f7-817e-0ffe1d078db9-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:36.194699 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.194694    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/43741752-6fc9-47f7-817e-0ffe1d078db9-kube-api-access-tbtp4\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:36.328319 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.328226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:36.359317 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.359284    2572 generic.go:356] "Generic (PLEG): container finished" podID="43741752-6fc9-47f7-817e-0ffe1d078db9" containerID="b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104" exitCode=0
Jul 28 21:24:36.359470 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.359346    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"
Jul 28 21:24:36.359470 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.359364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms" event={"ID":"43741752-6fc9-47f7-817e-0ffe1d078db9","Type":"ContainerDied","Data":"b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104"}
Jul 28 21:24:36.359470 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.359433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms" event={"ID":"43741752-6fc9-47f7-817e-0ffe1d078db9","Type":"ContainerDied","Data":"616e49ed45268bdaa07bcc8c74101526f94096f1f04f28f2b4a73b92b991b1c4"}
Jul 28 21:24:36.359470 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.359455    2572 scope.go:117] "RemoveContainer" containerID="b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104"
Jul 28 21:24:36.368800 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.368765    2572 scope.go:117] "RemoveContainer" containerID="b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104"
Jul 28 21:24:36.369077 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:36.369057    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104\": container with ID starting with b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104 not found: ID does not exist" containerID="b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104"
Jul 28 21:24:36.369142 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.369091    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104"} err="failed to get container status \"b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104\": rpc error: code = NotFound desc = could not find container \"b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104\": container with ID starting with b2a5f8b80fb750c1cfcce8d58aa373fc828a429e9eb872f700f6d429fd047104 not found: ID does not exist"
Jul 28 21:24:36.384450 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.384420    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"]
Jul 28 21:24:36.389703 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.389680    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9bf2ee-5fbd488bcd-qt9ms"]
Jul 28 21:24:36.827292 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:36.827258    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:37.717449 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:37.717413    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43741752-6fc9-47f7-817e-0ffe1d078db9" path="/var/lib/kubelet/pods/43741752-6fc9-47f7-817e-0ffe1d078db9/volumes"
Jul 28 21:24:42.568275 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:42.568241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:42.623663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:42.623625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:42.734973 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:42.734937    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"]
Jul 28 21:24:42.735178 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:42.735157    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy" containerID="cri-o://6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9" gracePeriod=30
Jul 28 21:24:42.753113 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:42.753081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:42.992959 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:42.992923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:43.357093 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.357000    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:43.655856 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.655830    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"]
Jul 28 21:24:43.656239 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656210    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy"
Jul 28 21:24:43.656239 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656221    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy"
Jul 28 21:24:43.656239 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656229    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy"
Jul 28 21:24:43.656239 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656234    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656245    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43741752-6fc9-47f7-817e-0ffe1d078db9" containerName="maas-api"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656252    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="43741752-6fc9-47f7-817e-0ffe1d078db9" containerName="maas-api"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656267    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986391f4-ed73-41a5-bf89-4bb631faa59f" containerName="payload-processing"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656273    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="986391f4-ed73-41a5-bf89-4bb631faa59f" containerName="payload-processing"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656284    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" containerName="payload-pre-processing"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656289    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" containerName="payload-pre-processing"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656294    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" containerName="maas-api"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656299    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" containerName="maas-api"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656362    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2743c4eb-e887-4ced-ab7b-eb5ddb8d0f81" containerName="payload-pre-processing"
Jul 28 21:24:43.656366 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656370    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy"
Jul 28 21:24:43.656667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656376    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="986391f4-ed73-41a5-bf89-4bb631faa59f" containerName="payload-processing"
Jul 28 21:24:43.656667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656383    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1bb2ed-cb8e-4d1d-8db7-8db56d35b6c2" containerName="maas-api"
Jul 28 21:24:43.656667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.656390    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="43741752-6fc9-47f7-817e-0ffe1d078db9" containerName="maas-api"
Jul 28 21:24:43.660667 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.660650    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.663253 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.663237    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ee8397-openshift-default-dockercfg-kkd4r\""
Jul 28 21:24:43.682082 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.682051    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"]
Jul 28 21:24:43.698073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.698038    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:43.764593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-envoy\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.764826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764624    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-credential-socket\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.764826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764681    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-socket\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.764826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-certs\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.764986 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-data\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.764986 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764867    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-podinfo\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.764986 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istiod-ca-cert\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.765097 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.764985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-token\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.765097 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.765020    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqh5l\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-kube-api-access-vqh5l\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.837952 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.837903    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:43.865843 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.865805    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-envoy\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866034 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.865863    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-credential-socket\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866034 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.865895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-socket\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866034 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.865918    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-certs\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866034 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.865979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-data\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866034 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-podinfo\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866034 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866029    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istiod-ca-cert\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866336 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-token\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866336 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866127    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqh5l\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-kube-api-access-vqh5l\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866336 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-credential-socket\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866522 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866498    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-certs\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866578 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-data\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866624 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866615    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-socket\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.866865 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.866847    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istiod-ca-cert\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.868927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.868909    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-envoy\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.869146 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.869127    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-podinfo\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.874442 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.874417    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-token\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.874857 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.874825    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqh5l\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-kube-api-access-vqh5l\") pod \"e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") " pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:43.971141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:43.971058    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:44.119845 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.119818    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"]
Jul 28 21:24:44.122086 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:24:44.122056    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd1aef8_3bf2_4f29_adcd_5df87684d0c6.slice/crio-28cde081b66fa402108c95222f0695ad438fd2cd5c662fdb002d82e8f8a34320 WatchSource:0}: Error finding container 28cde081b66fa402108c95222f0695ad438fd2cd5c662fdb002d82e8f8a34320: Status 404 returned error can't find the container with id 28cde081b66fa402108c95222f0695ad438fd2cd5c662fdb002d82e8f8a34320
Jul 28 21:24:44.124563 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.124527    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:24:44.124646 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.124602    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:24:44.124646 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.124631    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:24:44.401589 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.401542    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" event={"ID":"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6","Type":"ContainerStarted","Data":"a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32"}
Jul 28 21:24:44.401589 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.401596    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" event={"ID":"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6","Type":"ContainerStarted","Data":"28cde081b66fa402108c95222f0695ad438fd2cd5c662fdb002d82e8f8a34320"}
Jul 28 21:24:44.422100 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.422048    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" podStartSLOduration=1.4220296239999999 podStartE2EDuration="1.422029624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:24:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:24:44.420244017 +0000 UTC m=+2389.254487604" watchObservedRunningTime="2026-07-28 21:24:44.422029624 +0000 UTC m=+2389.256273210"
Jul 28 21:24:44.971571 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:44.971543    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:45.977152 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:45.977121    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:46.385146 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.385114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:46.412499 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.412464    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:46.413569 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.413550    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:24:46.458059 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.458029    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"]
Jul 28 21:24:46.458459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.458445    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b2104e-e783-45c3-9a2f-4e04eaa055ba" containerName="istio-proxy"
Jul 28 21:24:46.461841 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.461768    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.465356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.464803    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ee8397-serving-cert\""
Jul 28 21:24:46.472389 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.472223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"]
Jul 28 21:24:46.493528 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.493490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:46.594665 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.594626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwmmm\" (UniqueName: \"kubernetes.io/projected/f0e94837-81f6-46d7-9fae-9dca4ba0263b-kube-api-access-rwmmm\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.594920 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.594762    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e94837-81f6-46d7-9fae-9dca4ba0263b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.595007 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.594954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.595587 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.595563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:46.695835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.695718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.695835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.695767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmmm\" (UniqueName: \"kubernetes.io/projected/f0e94837-81f6-46d7-9fae-9dca4ba0263b-kube-api-access-rwmmm\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.695835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.695817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e94837-81f6-46d7-9fae-9dca4ba0263b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.696079 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:46.695874    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-serving-cert: secret "maas-api-e2e-api-a-ee8397-serving-cert" not found
Jul 28 21:24:46.696079 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:46.695947    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls podName:f0e94837-81f6-46d7-9fae-9dca4ba0263b nodeName:}" failed. No retries permitted until 2026-07-28 21:24:47.195931005 +0000 UTC m=+2392.030174569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls") pod "maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" (UID: "f0e94837-81f6-46d7-9fae-9dca4ba0263b") : secret "maas-api-e2e-api-a-ee8397-serving-cert" not found
Jul 28 21:24:46.696457 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.696440    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e94837-81f6-46d7-9fae-9dca4ba0263b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:46.704654 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:46.704629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwmmm\" (UniqueName: \"kubernetes.io/projected/f0e94837-81f6-46d7-9fae-9dca4ba0263b-kube-api-access-rwmmm\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:47.188901 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.188866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:47.201089 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.201047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:47.201253 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:47.201214    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-serving-cert: secret "maas-api-e2e-api-a-ee8397-serving-cert" not found
Jul 28 21:24:47.201299 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:47.201282    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls podName:f0e94837-81f6-46d7-9fae-9dca4ba0263b nodeName:}" failed. No retries permitted until 2026-07-28 21:24:48.201266976 +0000 UTC m=+2393.035510540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls") pod "maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" (UID: "f0e94837-81f6-46d7-9fae-9dca4ba0263b") : secret "maas-api-e2e-api-a-ee8397-serving-cert" not found
Jul 28 21:24:47.288648 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.288610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:24:47.382565 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.382527    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"]
Jul 28 21:24:47.386159 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.386141    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.388819 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.388769    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-ee8397-dockercfg-47xmr\""
Jul 28 21:24:47.388961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.388875    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-ee8397\""
Jul 28 21:24:47.395358 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.395332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"]
Jul 28 21:24:47.504567 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.504469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9tw6\" (UniqueName: \"kubernetes.io/projected/cc1e3548-ca20-43a8-8410-fa721c298d04-kube-api-access-m9tw6\") pod \"payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.504750 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.504577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1e3548-ca20-43a8-8410-fa721c298d04-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.605936 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.605893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9tw6\" (UniqueName: \"kubernetes.io/projected/cc1e3548-ca20-43a8-8410-fa721c298d04-kube-api-access-m9tw6\") pod \"payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.606139 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.606070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1e3548-ca20-43a8-8410-fa721c298d04-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.606709 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.606688    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1e3548-ca20-43a8-8410-fa721c298d04-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.618666 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.618629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9tw6\" (UniqueName: \"kubernetes.io/projected/cc1e3548-ca20-43a8-8410-fa721c298d04-kube-api-access-m9tw6\") pod \"payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.697922 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.697886    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:47.845184 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:47.845158    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"]
Jul 28 21:24:47.847704 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:24:47.847674    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1e3548_ca20_43a8_8410_fa721c298d04.slice/crio-1a067f8dc0e77f800966f4cdd0b206040383b6ac6cd01e469c408e32a6f0b6d9 WatchSource:0}: Error finding container 1a067f8dc0e77f800966f4cdd0b206040383b6ac6cd01e469c408e32a6f0b6d9: Status 404 returned error can't find the container with id 1a067f8dc0e77f800966f4cdd0b206040383b6ac6cd01e469c408e32a6f0b6d9
Jul 28 21:24:48.002846 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.002819    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:24:48.111559 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111464    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-token\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.111559 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-podinfo\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.111559 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111531    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-credential-socket\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.111905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111566    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-data\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.111905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111684    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357bca7a-60c3-4a80-876f-ed626c4ca455-istiod-ca-cert\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.111905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111859    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-certs\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.111905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111873    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:48.111905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111890    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-envoy\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.112173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.111979    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx228\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-kube-api-access-tx228\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.112173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112007    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-socket\") pod \"357bca7a-60c3-4a80-876f-ed626c4ca455\" (UID: \"357bca7a-60c3-4a80-876f-ed626c4ca455\") "
Jul 28 21:24:48.112173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112073    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357bca7a-60c3-4a80-876f-ed626c4ca455-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:24:48.112173 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112122    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:48.112544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112325    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:48.112544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112397    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.112544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112416    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357bca7a-60c3-4a80-876f-ed626c4ca455-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.112544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112425    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.112544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112432    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.112835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.112558    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-data" (OuterVolumeSpecName: "istio-data") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:48.113981 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.113961    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:24:48.114202 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.114186    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-kube-api-access-tx228" (OuterVolumeSpecName: "kube-api-access-tx228") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "kube-api-access-tx228". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:48.114403 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.114376    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:24:48.114403 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.114386    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-token" (OuterVolumeSpecName: "istio-token") pod "357bca7a-60c3-4a80-876f-ed626c4ca455" (UID: "357bca7a-60c3-4a80-876f-ed626c4ca455"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:24:48.213440 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.213400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:48.213969 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.213475    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.213969 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.213491    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx228\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-kube-api-access-tx228\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.213969 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.213503    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.213969 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.213513    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.213969 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.213522    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357bca7a-60c3-4a80-876f-ed626c4ca455-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:24:48.216084 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.216058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls\") pod \"maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:48.276415 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.276372    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:48.420609 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.420582    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"]
Jul 28 21:24:48.424422 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:24:48.424396    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e94837_81f6_46d7_9fae_9dca4ba0263b.slice/crio-a1a99218b9625b6c06b986d1f7e8abe50084437d05db3bf519379f97aac3bf95 WatchSource:0}: Error finding container a1a99218b9625b6c06b986d1f7e8abe50084437d05db3bf519379f97aac3bf95: Status 404 returned error can't find the container with id a1a99218b9625b6c06b986d1f7e8abe50084437d05db3bf519379f97aac3bf95
Jul 28 21:24:48.426030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.426008    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 21:24:48.427694 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.427667    2572 generic.go:356] "Generic (PLEG): container finished" podID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerID="6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9" exitCode=0
Jul 28 21:24:48.427835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.427715    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"
Jul 28 21:24:48.427835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.427744    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" event={"ID":"357bca7a-60c3-4a80-876f-ed626c4ca455","Type":"ContainerDied","Data":"6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9"}
Jul 28 21:24:48.427835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.427814    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4" event={"ID":"357bca7a-60c3-4a80-876f-ed626c4ca455","Type":"ContainerDied","Data":"c73a89f5889b94671f6b18072b6c88a4c43bf71f0f630b7a55665e160e179d85"}
Jul 28 21:24:48.427996 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.427846    2572 scope.go:117] "RemoveContainer" containerID="6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9"
Jul 28 21:24:48.429567 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.429538    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx" event={"ID":"cc1e3548-ca20-43a8-8410-fa721c298d04","Type":"ContainerStarted","Data":"382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb"}
Jul 28 21:24:48.429694 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.429600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx" event={"ID":"cc1e3548-ca20-43a8-8410-fa721c298d04","Type":"ContainerStarted","Data":"1a067f8dc0e77f800966f4cdd0b206040383b6ac6cd01e469c408e32a6f0b6d9"}
Jul 28 21:24:48.429854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.429803    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:48.438085 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.438068    2572 scope.go:117] "RemoveContainer" containerID="b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843"
Jul 28 21:24:48.446839 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.446812    2572 scope.go:117] "RemoveContainer" containerID="6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9"
Jul 28 21:24:48.447154 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.447113    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx" podStartSLOduration=1.447097809 podStartE2EDuration="1.447097809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:24:48.446020605 +0000 UTC m=+2393.280264192" watchObservedRunningTime="2026-07-28 21:24:48.447097809 +0000 UTC m=+2393.281341394"
Jul 28 21:24:48.447154 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:48.447143    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9\": container with ID starting with 6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9 not found: ID does not exist" containerID="6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9"
Jul 28 21:24:48.447269 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.447171    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9"} err="failed to get container status \"6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9\": rpc error: code = NotFound desc = could not find container \"6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9\": container with ID starting with 6748f659a768be79e9db5dd31d09ccd3af8c128f1b7d5244e67854095d5724a9 not found: ID does not exist"
Jul 28 21:24:48.447269 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.447190    2572 scope.go:117] "RemoveContainer" containerID="b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843"
Jul 28 21:24:48.447472 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:24:48.447454    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843\": container with ID starting with b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843 not found: ID does not exist" containerID="b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843"
Jul 28 21:24:48.447524 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.447483    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843"} err="failed to get container status \"b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843\": rpc error: code = NotFound desc = could not find container \"b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843\": container with ID starting with b6a7144b4faf06bd5e7addaa0c83a8bbb4cb9402f3dee9291f9ee5722158f843 not found: ID does not exist"
Jul 28 21:24:48.459203 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.459164    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"]
Jul 28 21:24:48.462599 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:48.462573    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4"]
Jul 28 21:24:49.436000 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:49.435964    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" event={"ID":"f0e94837-81f6-46d7-9fae-9dca4ba0263b","Type":"ContainerStarted","Data":"05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496"}
Jul 28 21:24:49.436477 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:49.436041    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:49.436477 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:49.436062    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" event={"ID":"f0e94837-81f6-46d7-9fae-9dca4ba0263b","Type":"ContainerStarted","Data":"a1a99218b9625b6c06b986d1f7e8abe50084437d05db3bf519379f97aac3bf95"}
Jul 28 21:24:49.453202 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:49.453134    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" podStartSLOduration=2.905473745 podStartE2EDuration="3.453115399s" totalImagesPullingTime="547.641654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:24:49.453074792 +0000 UTC m=+2394.287318382" watchObservedRunningTime="2026-07-28 21:24:49.453115399 +0000 UTC m=+2394.287358982"
Jul 28 21:24:49.717639 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:49.717558    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" path="/var/lib/kubelet/pods/357bca7a-60c3-4a80-876f-ed626c4ca455/volumes"
Jul 28 21:24:55.446798 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:55.446752    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:24:55.821137 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:55.821043    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:24:55.821373 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:55.821234    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:24:59.439502 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:59.439471    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:24:59.490102 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:59.490066    2572 generic.go:356] "Generic (PLEG): container finished" podID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerID="a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32" exitCode=0
Jul 28 21:24:59.490306 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:59.490139    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" event={"ID":"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6","Type":"ContainerDied","Data":"a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32"}
Jul 28 21:24:59.490570 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:59.490554    2572 scope.go:117] "RemoveContainer" containerID="a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32"
Jul 28 21:24:59.491592 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:59.491561    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:24:59.491679 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:59.491650    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:24:59.491734 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:24:59.491697    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:25:00.499490 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:00.499451    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" event={"ID":"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6","Type":"ContainerStarted","Data":"333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2"}
Jul 28 21:25:00.971599 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:00.971566    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:25:00.973024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:00.972987    2572 patch_prober.go:28] interesting pod/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 21:25:00.973176 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:00.973070    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 21:25:01.412609 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:01.412574    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:25:01.972513 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:01.972476    2572 patch_prober.go:28] interesting pod/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 21:25:01.972980 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:01.972535    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 21:25:02.972256 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:02.972223    2572 patch_prober.go:28] interesting pod/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 21:25:02.972453 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:02.972277    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 21:25:03.971734 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:03.971699    2572 patch_prober.go:28] interesting pod/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 21:25:03.972139 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:03.971759    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 21:25:04.981264 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:04.981234    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:25:04.982285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:04.982267    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:25:07.158953 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:07.158914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:11.449730 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:11.449682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:11.962360 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:11.962321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:12.270297 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.270197    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"]
Jul 28 21:25:12.270679 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.270663    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy"
Jul 28 21:25:12.270817 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.270683    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy"
Jul 28 21:25:12.270889 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.270834    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy"
Jul 28 21:25:12.270889 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.270848    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy"
Jul 28 21:25:12.274145 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.274125    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.277038 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.277015    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-074f3a-openshift-default-dockercfg-8bqgq\""
Jul 28 21:25:12.285322 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.285294    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"]
Jul 28 21:25:12.299474 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.299441    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:12.340319 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-socket\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340319 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340316    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-data\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340558 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-envoy\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340558 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-token\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340558 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istiod-ca-cert\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340558 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-certs\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340558 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340539    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58q6j\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-kube-api-access-58q6j\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-credential-socket\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.340828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.340617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-podinfo\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.441694 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-certs\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.441694 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441694    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58q6j\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-kube-api-access-58q6j\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-credential-socket\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441746    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-podinfo\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-socket\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441859    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-data\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-envoy\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-token\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442024 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.441971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istiod-ca-cert\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442378 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.442183    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-certs\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442378 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.442231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-credential-socket\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442519 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.442493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-data\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442587 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.442540    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-socket\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.442626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.442612    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istiod-ca-cert\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.444484 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.444462    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-envoy\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.444602 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.444549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-podinfo\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.451553 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.451525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-token\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.451924 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.451819    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58q6j\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-kube-api-access-58q6j\") pod \"e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") " pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.515305 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.515271    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:12.586930 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.586832    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:12.742406 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.742377    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"]
Jul 28 21:25:12.744068 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:25:12.744031    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba67fe3_e139_4ef2_ab44_4692d9da177e.slice/crio-957370e8cd80353e9def26b209c0806117cadbc38b0df557c2a306340017fe4e WatchSource:0}: Error finding container 957370e8cd80353e9def26b209c0806117cadbc38b0df557c2a306340017fe4e: Status 404 returned error can't find the container with id 957370e8cd80353e9def26b209c0806117cadbc38b0df557c2a306340017fe4e
Jul 28 21:25:12.746192 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.746158    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:25:12.746301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.746231    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:25:12.746301 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:12.746260    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:25:13.563412 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:13.563374    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" event={"ID":"4ba67fe3-e139-4ef2-ab44-4692d9da177e","Type":"ContainerStarted","Data":"1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef"}
Jul 28 21:25:13.563845 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:13.563425    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" event={"ID":"4ba67fe3-e139-4ef2-ab44-4692d9da177e","Type":"ContainerStarted","Data":"957370e8cd80353e9def26b209c0806117cadbc38b0df557c2a306340017fe4e"}
Jul 28 21:25:13.585791 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:13.585736    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" podStartSLOduration=1.585719466 podStartE2EDuration="1.585719466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:25:13.584211251 +0000 UTC m=+2418.418454838" watchObservedRunningTime="2026-07-28 21:25:13.585719466 +0000 UTC m=+2418.419963051"
Jul 28 21:25:13.587012 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:13.586991    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:13.592496 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:13.592470    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:14.568753 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:14.568719    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:14.569895 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:14.569880    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:15.585489 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:15.585456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:15.677498 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:15.677462    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:15.927847 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:15.927812    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:16.141676 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.141598    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:16.436137 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.436100    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:16.540322 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.540289    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:16.548631 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.548598    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"]
Jul 28 21:25:16.549035 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.549021    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy"
Jul 28 21:25:16.549035 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.549038    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="357bca7a-60c3-4a80-876f-ed626c4ca455" containerName="istio-proxy"
Jul 28 21:25:16.552459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.552443    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.558907 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.558876    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-074f3a-dockercfg-n45nc\""
Jul 28 21:25:16.559071 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.558926    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-074f3a\""
Jul 28 21:25:16.583130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.583093    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"]
Jul 28 21:25:16.586298 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.586270    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"]
Jul 28 21:25:16.590072 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.590049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:16.596235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.596198    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"]
Jul 28 21:25:16.684897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.684857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec03044a-4fcd-45d1-a018-f9608c4478fc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") " pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:16.685107 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.684958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.685201 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.685101    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4gfw\" (UniqueName: \"kubernetes.io/projected/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-kube-api-access-w4gfw\") pod \"payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.685201 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.685140    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82xqv\" (UniqueName: \"kubernetes.io/projected/ec03044a-4fcd-45d1-a018-f9608c4478fc-kube-api-access-82xqv\") pod \"payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") " pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:16.786133 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.786033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4gfw\" (UniqueName: \"kubernetes.io/projected/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-kube-api-access-w4gfw\") pod \"payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.786133 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.786081    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82xqv\" (UniqueName: \"kubernetes.io/projected/ec03044a-4fcd-45d1-a018-f9608c4478fc-kube-api-access-82xqv\") pod \"payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") " pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:16.786133 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.786118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec03044a-4fcd-45d1-a018-f9608c4478fc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") " pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:16.786422 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.786165    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.786965 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.786944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.787030 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.786975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec03044a-4fcd-45d1-a018-f9608c4478fc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") " pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:16.795133 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.795104    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82xqv\" (UniqueName: \"kubernetes.io/projected/ec03044a-4fcd-45d1-a018-f9608c4478fc-kube-api-access-82xqv\") pod \"payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") " pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:16.795258 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.795233    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4gfw\" (UniqueName: \"kubernetes.io/projected/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-kube-api-access-w4gfw\") pod \"payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.863124 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.863087    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:16.903018 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:16.902907    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:17.015828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.015771    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"]
Jul 28 21:25:17.016846 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:25:17.016807    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43dbf6e7_613c_4ae4_858e_3b43c32d5d1e.slice/crio-14fa3bfcb20999e00b69f2e6ab51663b328d2f55349a33b02b36d45697600df9 WatchSource:0}: Error finding container 14fa3bfcb20999e00b69f2e6ab51663b328d2f55349a33b02b36d45697600df9: Status 404 returned error can't find the container with id 14fa3bfcb20999e00b69f2e6ab51663b328d2f55349a33b02b36d45697600df9
Jul 28 21:25:17.070804 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.070763    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"]
Jul 28 21:25:17.078998 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:25:17.078969    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec03044a_4fcd_45d1_a018_f9608c4478fc.slice/crio-44ead6b50a805a479b9ac516d46fac1d69db5bff4f4bccc31e10b188014b60ca WatchSource:0}: Error finding container 44ead6b50a805a479b9ac516d46fac1d69db5bff4f4bccc31e10b188014b60ca: Status 404 returned error can't find the container with id 44ead6b50a805a479b9ac516d46fac1d69db5bff4f4bccc31e10b188014b60ca
Jul 28 21:25:17.596761 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.596720    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89" event={"ID":"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e","Type":"ContainerStarted","Data":"ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d"}
Jul 28 21:25:17.597276 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.596806    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89" event={"ID":"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e","Type":"ContainerStarted","Data":"14fa3bfcb20999e00b69f2e6ab51663b328d2f55349a33b02b36d45697600df9"}
Jul 28 21:25:17.597276 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.596935    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:17.598305 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.598284    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s" event={"ID":"ec03044a-4fcd-45d1-a018-f9608c4478fc","Type":"ContainerStarted","Data":"74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797"}
Jul 28 21:25:17.598376 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.598329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s" event={"ID":"ec03044a-4fcd-45d1-a018-f9608c4478fc","Type":"ContainerStarted","Data":"44ead6b50a805a479b9ac516d46fac1d69db5bff4f4bccc31e10b188014b60ca"}
Jul 28 21:25:17.598376 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.598365    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:17.614476 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.614421    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89" podStartSLOduration=1.6144059579999999 podStartE2EDuration="1.614405958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:25:17.611878067 +0000 UTC m=+2422.446121655" watchObservedRunningTime="2026-07-28 21:25:17.614405958 +0000 UTC m=+2422.448649544"
Jul 28 21:25:17.630100 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:17.630043    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s" podStartSLOduration=1.6300248640000001 podStartE2EDuration="1.630024864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:25:17.628766858 +0000 UTC m=+2422.463010445" watchObservedRunningTime="2026-07-28 21:25:17.630024864 +0000 UTC m=+2422.464268450"
Jul 28 21:25:28.606771 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.606739    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:25:28.607235 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.606946    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:25:28.671004 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.670858    2572 generic.go:356] "Generic (PLEG): container finished" podID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerID="1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef" exitCode=0
Jul 28 21:25:28.671004 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.670928    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" event={"ID":"4ba67fe3-e139-4ef2-ab44-4692d9da177e","Type":"ContainerDied","Data":"1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef"}
Jul 28 21:25:28.671660 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.671637    2572 scope.go:117] "RemoveContainer" containerID="1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef"
Jul 28 21:25:28.672928 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.672886    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:25:28.673014 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.672985    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:25:28.673057 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:28.673031    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:25:29.569251 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:29.569219    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:29.680374 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:29.680335    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" event={"ID":"4ba67fe3-e139-4ef2-ab44-4692d9da177e","Type":"ContainerStarted","Data":"0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655"}
Jul 28 21:25:30.587396 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:30.587349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:30.589153 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:30.589121    2572 patch_prober.go:28] interesting pod/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 21:25:30.589414 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:30.589388    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 21:25:31.588390 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:31.588349    2572 patch_prober.go:28] interesting pod/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 21:25:31.589453 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:31.589017    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 21:25:32.587692 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:32.587653    2572 patch_prober.go:28] interesting pod/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 21:25:32.588054 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:32.588018    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 21:25:33.587548 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:33.587496    2572 patch_prober.go:28] interesting pod/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 28 21:25:33.588138 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:33.587572    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 28 21:25:34.592135 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:34.592105    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:34.592536 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:34.592488    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:34.593145 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:34.593129    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:25:40.610524 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:40.610485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:45.651637 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:45.651600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:59.270061 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.270026    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"]
Jul 28 21:25:59.270564 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.270264    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" podUID="f0e94837-81f6-46d7-9fae-9dca4ba0263b" containerName="maas-api" containerID="cri-o://05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496" gracePeriod=30
Jul 28 21:25:59.304794 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.304751    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:59.334656 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.334551    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"]
Jul 28 21:25:59.334908 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.334883    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx" podUID="cc1e3548-ca20-43a8-8410-fa721c298d04" containerName="payload-pre-processing" containerID="cri-o://382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb" gracePeriod=30
Jul 28 21:25:59.404415 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.404382    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:59.437618 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.437566    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx" podUID="cc1e3548-ca20-43a8-8410-fa721c298d04" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.64:9004: connect: connection refused"
Jul 28 21:25:59.468339 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.468302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:59.618455 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.618424    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:25:59.632672 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.632641    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:25:59.705640 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.705608    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9tw6\" (UniqueName: \"kubernetes.io/projected/cc1e3548-ca20-43a8-8410-fa721c298d04-kube-api-access-m9tw6\") pod \"cc1e3548-ca20-43a8-8410-fa721c298d04\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") "
Jul 28 21:25:59.705853 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.705654    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e94837-81f6-46d7-9fae-9dca4ba0263b-openshift-service-ca\") pod \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") "
Jul 28 21:25:59.705853 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.705684    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls\") pod \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") "
Jul 28 21:25:59.705853 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.705761    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1e3548-ca20-43a8-8410-fa721c298d04-plugins-config-volume\") pod \"cc1e3548-ca20-43a8-8410-fa721c298d04\" (UID: \"cc1e3548-ca20-43a8-8410-fa721c298d04\") "
Jul 28 21:25:59.706062 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.705866    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwmmm\" (UniqueName: \"kubernetes.io/projected/f0e94837-81f6-46d7-9fae-9dca4ba0263b-kube-api-access-rwmmm\") pod \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\" (UID: \"f0e94837-81f6-46d7-9fae-9dca4ba0263b\") "
Jul 28 21:25:59.706160 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.706132    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0e94837-81f6-46d7-9fae-9dca4ba0263b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0e94837-81f6-46d7-9fae-9dca4ba0263b" (UID: "f0e94837-81f6-46d7-9fae-9dca4ba0263b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:25:59.706219 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.706159    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1e3548-ca20-43a8-8410-fa721c298d04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc1e3548-ca20-43a8-8410-fa721c298d04" (UID: "cc1e3548-ca20-43a8-8410-fa721c298d04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:25:59.708109 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.708074    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0e94837-81f6-46d7-9fae-9dca4ba0263b" (UID: "f0e94837-81f6-46d7-9fae-9dca4ba0263b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:25:59.708213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.708190    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e94837-81f6-46d7-9fae-9dca4ba0263b-kube-api-access-rwmmm" (OuterVolumeSpecName: "kube-api-access-rwmmm") pod "f0e94837-81f6-46d7-9fae-9dca4ba0263b" (UID: "f0e94837-81f6-46d7-9fae-9dca4ba0263b"). InnerVolumeSpecName "kube-api-access-rwmmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:25:59.708257 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.708223    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1e3548-ca20-43a8-8410-fa721c298d04-kube-api-access-m9tw6" (OuterVolumeSpecName: "kube-api-access-m9tw6") pod "cc1e3548-ca20-43a8-8410-fa721c298d04" (UID: "cc1e3548-ca20-43a8-8410-fa721c298d04"). InnerVolumeSpecName "kube-api-access-m9tw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:25:59.807416 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.807381    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1e3548-ca20-43a8-8410-fa721c298d04-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:25:59.807416 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.807408    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwmmm\" (UniqueName: \"kubernetes.io/projected/f0e94837-81f6-46d7-9fae-9dca4ba0263b-kube-api-access-rwmmm\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:25:59.807416 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.807417    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9tw6\" (UniqueName: \"kubernetes.io/projected/cc1e3548-ca20-43a8-8410-fa721c298d04-kube-api-access-m9tw6\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:25:59.807658 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.807429    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e94837-81f6-46d7-9fae-9dca4ba0263b-openshift-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:25:59.807658 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.807438    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e94837-81f6-46d7-9fae-9dca4ba0263b-maas-api-tls\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:25:59.825493 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.825422    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:25:59.837229 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.837199    2572 generic.go:356] "Generic (PLEG): container finished" podID="f0e94837-81f6-46d7-9fae-9dca4ba0263b" containerID="05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496" exitCode=0
Jul 28 21:25:59.837380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.837247    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"
Jul 28 21:25:59.837380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.837290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" event={"ID":"f0e94837-81f6-46d7-9fae-9dca4ba0263b","Type":"ContainerDied","Data":"05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496"}
Jul 28 21:25:59.837380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.837342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c" event={"ID":"f0e94837-81f6-46d7-9fae-9dca4ba0263b","Type":"ContainerDied","Data":"a1a99218b9625b6c06b986d1f7e8abe50084437d05db3bf519379f97aac3bf95"}
Jul 28 21:25:59.837380 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.837367    2572 scope.go:117] "RemoveContainer" containerID="05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496"
Jul 28 21:25:59.839002 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.838833    2572 generic.go:356] "Generic (PLEG): container finished" podID="cc1e3548-ca20-43a8-8410-fa721c298d04" containerID="382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb" exitCode=0
Jul 28 21:25:59.839002 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.838893    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"
Jul 28 21:25:59.839002 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.838930    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx" event={"ID":"cc1e3548-ca20-43a8-8410-fa721c298d04","Type":"ContainerDied","Data":"382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb"}
Jul 28 21:25:59.839002 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.838969    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx" event={"ID":"cc1e3548-ca20-43a8-8410-fa721c298d04","Type":"ContainerDied","Data":"1a067f8dc0e77f800966f4cdd0b206040383b6ac6cd01e469c408e32a6f0b6d9"}
Jul 28 21:25:59.847463 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.847447    2572 scope.go:117] "RemoveContainer" containerID="05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496"
Jul 28 21:25:59.847771 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:25:59.847740    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496\": container with ID starting with 05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496 not found: ID does not exist" containerID="05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496"
Jul 28 21:25:59.847888 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.847772    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496"} err="failed to get container status \"05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496\": rpc error: code = NotFound desc = could not find container \"05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496\": container with ID starting with 05047bdf294e01fdc16114a345811ea4e830540cd9e3c45e290a47b21554b496 not found: ID does not exist"
Jul 28 21:25:59.847888 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.847822    2572 scope.go:117] "RemoveContainer" containerID="382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb"
Jul 28 21:25:59.856685 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.856643    2572 scope.go:117] "RemoveContainer" containerID="382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb"
Jul 28 21:25:59.857582 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:25:59.857553    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb\": container with ID starting with 382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb not found: ID does not exist" containerID="382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb"
Jul 28 21:25:59.857678 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.857591    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb"} err="failed to get container status \"382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb\": rpc error: code = NotFound desc = could not find container \"382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb\": container with ID starting with 382203035e63c4ae3c37021626faa66b977357969fb5c575e8561577fbc903eb not found: ID does not exist"
Jul 28 21:25:59.859507 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.859485    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"]
Jul 28 21:25:59.864908 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.864887    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee8397-7884c76d5d-xd62c"]
Jul 28 21:25:59.876546 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.876521    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"]
Jul 28 21:25:59.883974 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:25:59.883953    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx"]
Jul 28 21:26:01.718280 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:01.718243    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1e3548-ca20-43a8-8410-fa721c298d04" path="/var/lib/kubelet/pods/cc1e3548-ca20-43a8-8410-fa721c298d04/volumes"
Jul 28 21:26:01.718846 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:01.718753    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e94837-81f6-46d7-9fae-9dca4ba0263b" path="/var/lib/kubelet/pods/f0e94837-81f6-46d7-9fae-9dca4ba0263b/volumes"
Jul 28 21:26:05.939265 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:05.939227    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:06.060461 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:06.060426    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:06.243741 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:06.243646    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"]
Jul 28 21:26:06.243918 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:06.243888    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy" containerID="cri-o://333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2" gracePeriod=30
Jul 28 21:26:06.263832 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:06.263774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:06.461738 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:06.461697    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:11.500624 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.500599    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:26:11.626489 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626460    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-data\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.626663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626509    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-certs\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.626663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626526    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-token\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.626663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626552    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-envoy\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.626663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626566    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-socket\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.626663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626600    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istiod-ca-cert\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.626663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626636    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-credential-socket\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.626663 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626662    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-podinfo\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.627071 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626708    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqh5l\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-kube-api-access-vqh5l\") pod \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\" (UID: \"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6\") "
Jul 28 21:26:11.627071 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.626873    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:11.627071 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.627040    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:11.627240 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.627079    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.627240 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.627181    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:11.627359 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.627341    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:26:11.627928 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.627852    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:11.629050 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.629027    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:11.629050 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.629031    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:26:11.629050 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.629047    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:26:11.629467 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.629452    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-kube-api-access-vqh5l" (OuterVolumeSpecName: "kube-api-access-vqh5l") pod "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" (UID: "6cd1aef8-3bf2-4f29-adcd-5df87684d0c6"). InnerVolumeSpecName "kube-api-access-vqh5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:26:11.727833 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727806    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.727833 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727832    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.727992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727841    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.727992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727851    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.727992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727860    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.727992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727868    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.727992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727876    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.727992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.727885    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqh5l\" (UniqueName: \"kubernetes.io/projected/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6-kube-api-access-vqh5l\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:11.907141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.907049    2572 generic.go:356] "Generic (PLEG): container finished" podID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerID="333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2" exitCode=0
Jul 28 21:26:11.907141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.907105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" event={"ID":"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6","Type":"ContainerDied","Data":"333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2"}
Jul 28 21:26:11.907141 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.907107    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"
Jul 28 21:26:11.907435 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.907150    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt" event={"ID":"6cd1aef8-3bf2-4f29-adcd-5df87684d0c6","Type":"ContainerDied","Data":"28cde081b66fa402108c95222f0695ad438fd2cd5c662fdb002d82e8f8a34320"}
Jul 28 21:26:11.907435 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.907171    2572 scope.go:117] "RemoveContainer" containerID="333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2"
Jul 28 21:26:11.916201 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.916183    2572 scope.go:117] "RemoveContainer" containerID="a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32"
Jul 28 21:26:11.924898 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.924878    2572 scope.go:117] "RemoveContainer" containerID="333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2"
Jul 28 21:26:11.925168 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:26:11.925146    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2\": container with ID starting with 333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2 not found: ID does not exist" containerID="333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2"
Jul 28 21:26:11.925220 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.925182    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2"} err="failed to get container status \"333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2\": rpc error: code = NotFound desc = could not find container \"333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2\": container with ID starting with 333592e3131013a650862c91229e5114568fb6bde942fce520ad47ea21ae2cb2 not found: ID does not exist"
Jul 28 21:26:11.925220 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.925201    2572 scope.go:117] "RemoveContainer" containerID="a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32"
Jul 28 21:26:11.925464 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.925444    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"]
Jul 28 21:26:11.925564 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:26:11.925461    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32\": container with ID starting with a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32 not found: ID does not exist" containerID="a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32"
Jul 28 21:26:11.925564 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.925478    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32"} err="failed to get container status \"a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32\": rpc error: code = NotFound desc = could not find container \"a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32\": container with ID starting with a90c1f77bb011d88672f154b4ec42d68beb98c1f74dde209818a4bdfe8ea8d32 not found: ID does not exist"
Jul 28 21:26:11.934743 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:11.934722    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt"]
Jul 28 21:26:13.723210 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:13.723179    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" path="/var/lib/kubelet/pods/6cd1aef8-3bf2-4f29-adcd-5df87684d0c6/volumes"
Jul 28 21:26:22.026409 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.026378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:22.059218 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.059184    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"]
Jul 28 21:26:22.059508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.059451    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s" podUID="ec03044a-4fcd-45d1-a018-f9608c4478fc" containerName="payload-processing" containerID="cri-o://74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797" gracePeriod=30
Jul 28 21:26:22.065660 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.065625    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"]
Jul 28 21:26:22.065947 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.065918    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89" podUID="43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" containerName="payload-pre-processing" containerID="cri-o://ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d" gracePeriod=30
Jul 28 21:26:22.100009 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.099978    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:22.194872 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.194832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:22.254512 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.254471    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:22.319329 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.319305    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:26:22.356828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.356805    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:26:22.411254 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.411221    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-plugins-config-volume\") pod \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") "
Jul 28 21:26:22.411443 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.411306    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82xqv\" (UniqueName: \"kubernetes.io/projected/ec03044a-4fcd-45d1-a018-f9608c4478fc-kube-api-access-82xqv\") pod \"ec03044a-4fcd-45d1-a018-f9608c4478fc\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") "
Jul 28 21:26:22.411443 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.411368    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec03044a-4fcd-45d1-a018-f9608c4478fc-plugins-config-volume\") pod \"ec03044a-4fcd-45d1-a018-f9608c4478fc\" (UID: \"ec03044a-4fcd-45d1-a018-f9608c4478fc\") "
Jul 28 21:26:22.411443 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.411385    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4gfw\" (UniqueName: \"kubernetes.io/projected/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-kube-api-access-w4gfw\") pod \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\" (UID: \"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e\") "
Jul 28 21:26:22.411686 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.411656    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" (UID: "43dbf6e7-613c-4ae4-858e-3b43c32d5d1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:26:22.411826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.411765    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec03044a-4fcd-45d1-a018-f9608c4478fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec03044a-4fcd-45d1-a018-f9608c4478fc" (UID: "ec03044a-4fcd-45d1-a018-f9608c4478fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:26:22.413705 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.413681    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-kube-api-access-w4gfw" (OuterVolumeSpecName: "kube-api-access-w4gfw") pod "43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" (UID: "43dbf6e7-613c-4ae4-858e-3b43c32d5d1e"). InnerVolumeSpecName "kube-api-access-w4gfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:26:22.413832 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.413701    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec03044a-4fcd-45d1-a018-f9608c4478fc-kube-api-access-82xqv" (OuterVolumeSpecName: "kube-api-access-82xqv") pod "ec03044a-4fcd-45d1-a018-f9608c4478fc" (UID: "ec03044a-4fcd-45d1-a018-f9608c4478fc"). InnerVolumeSpecName "kube-api-access-82xqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:26:22.512356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.512321    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:22.512356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.512349    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82xqv\" (UniqueName: \"kubernetes.io/projected/ec03044a-4fcd-45d1-a018-f9608c4478fc-kube-api-access-82xqv\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:22.512356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.512358    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec03044a-4fcd-45d1-a018-f9608c4478fc-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:22.512591 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.512368    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4gfw\" (UniqueName: \"kubernetes.io/projected/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e-kube-api-access-w4gfw\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:22.590242 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.590146    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:22.968209 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.968170    2572 generic.go:356] "Generic (PLEG): container finished" podID="43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" containerID="ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d" exitCode=0
Jul 28 21:26:22.968413 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.968224    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"
Jul 28 21:26:22.968413 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.968258    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89" event={"ID":"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e","Type":"ContainerDied","Data":"ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d"}
Jul 28 21:26:22.968413 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.968317    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89" event={"ID":"43dbf6e7-613c-4ae4-858e-3b43c32d5d1e","Type":"ContainerDied","Data":"14fa3bfcb20999e00b69f2e6ab51663b328d2f55349a33b02b36d45697600df9"}
Jul 28 21:26:22.968413 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.968343    2572 scope.go:117] "RemoveContainer" containerID="ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d"
Jul 28 21:26:22.969692 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.969660    2572 generic.go:356] "Generic (PLEG): container finished" podID="ec03044a-4fcd-45d1-a018-f9608c4478fc" containerID="74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797" exitCode=0
Jul 28 21:26:22.969826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.969709    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"
Jul 28 21:26:22.969826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.969715    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s" event={"ID":"ec03044a-4fcd-45d1-a018-f9608c4478fc","Type":"ContainerDied","Data":"74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797"}
Jul 28 21:26:22.969826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.969754    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s" event={"ID":"ec03044a-4fcd-45d1-a018-f9608c4478fc","Type":"ContainerDied","Data":"44ead6b50a805a479b9ac516d46fac1d69db5bff4f4bccc31e10b188014b60ca"}
Jul 28 21:26:22.978290 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.978262    2572 scope.go:117] "RemoveContainer" containerID="ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d"
Jul 28 21:26:22.978678 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:26:22.978649    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d\": container with ID starting with ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d not found: ID does not exist" containerID="ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d"
Jul 28 21:26:22.978811 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.978690    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d"} err="failed to get container status \"ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d\": rpc error: code = NotFound desc = could not find container \"ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d\": container with ID starting with ce0827067026f2ea02875bb74163cb25118cbc0b425e1f25f83571ec532db97d not found: ID does not exist"
Jul 28 21:26:22.978811 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.978717    2572 scope.go:117] "RemoveContainer" containerID="74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797"
Jul 28 21:26:22.988037 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.988017    2572 scope.go:117] "RemoveContainer" containerID="74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797"
Jul 28 21:26:22.988383 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:26:22.988359    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797\": container with ID starting with 74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797 not found: ID does not exist" containerID="74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797"
Jul 28 21:26:22.988463 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.988396    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797"} err="failed to get container status \"74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797\": rpc error: code = NotFound desc = could not find container \"74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797\": container with ID starting with 74056e06cd2569bbc9bd5512f1c377dea9cf8c757240364052991516a7d1b797 not found: ID does not exist"
Jul 28 21:26:22.993121 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.993092    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"]
Jul 28 21:26:22.997050 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:22.997020    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89"]
Jul 28 21:26:23.007898 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:23.007855    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"]
Jul 28 21:26:23.009900 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:23.009872    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s"]
Jul 28 21:26:23.717851 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:23.717816    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" path="/var/lib/kubelet/pods/43dbf6e7-613c-4ae4-858e-3b43c32d5d1e/volumes"
Jul 28 21:26:23.718226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:23.718168    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec03044a-4fcd-45d1-a018-f9608c4478fc" path="/var/lib/kubelet/pods/ec03044a-4fcd-45d1-a018-f9608c4478fc/volumes"
Jul 28 21:26:28.776012 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:28.775971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:28.878046 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:28.878010    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:29.051826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.051683    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"]
Jul 28 21:26:29.052000 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.051966    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy" containerID="cri-o://0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655" gracePeriod=30
Jul 28 21:26:29.067226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.067192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:29.301053 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.301020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:29.683528 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.683501    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:29.990192 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990110    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"]
Jul 28 21:26:29.990668 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990649    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0e94837-81f6-46d7-9fae-9dca4ba0263b" containerName="maas-api"
Jul 28 21:26:29.990744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990671    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e94837-81f6-46d7-9fae-9dca4ba0263b" containerName="maas-api"
Jul 28 21:26:29.990744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990690    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1e3548-ca20-43a8-8410-fa721c298d04" containerName="payload-pre-processing"
Jul 28 21:26:29.990744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990699    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1e3548-ca20-43a8-8410-fa721c298d04" containerName="payload-pre-processing"
Jul 28 21:26:29.990744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990721    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy"
Jul 28 21:26:29.990744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990730    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy"
Jul 28 21:26:29.990744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990742    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" containerName="payload-pre-processing"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990750    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" containerName="payload-pre-processing"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990768    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec03044a-4fcd-45d1-a018-f9608c4478fc" containerName="payload-processing"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990794    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec03044a-4fcd-45d1-a018-f9608c4478fc" containerName="payload-processing"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990899    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990911    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="43dbf6e7-613c-4ae4-858e-3b43c32d5d1e" containerName="payload-pre-processing"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990925    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1e3548-ca20-43a8-8410-fa721c298d04" containerName="payload-pre-processing"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990936    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec03044a-4fcd-45d1-a018-f9608c4478fc" containerName="payload-processing"
Jul 28 21:26:29.991073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.990946    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0e94837-81f6-46d7-9fae-9dca4ba0263b" containerName="maas-api"
Jul 28 21:26:29.995569 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.995547    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:29.998267 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:29.998237    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b439d9-openshift-default-dockercfg-q57t8\""
Jul 28 21:26:30.006894 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.006862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"]
Jul 28 21:26:30.011208 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.011179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:30.082082 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082046    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-envoy\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082082 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-certs\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082333 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082186    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-token\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082333 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istiod-ca-cert\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082336    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-data\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-podinfo\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082401    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fntvg\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-kube-api-access-fntvg\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082584 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082439    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-socket\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.082584 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.082548    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-credential-socket\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183244 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183204    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-token\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183244 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istiod-ca-cert\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183276    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-data\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183303    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-podinfo\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fntvg\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-kube-api-access-fntvg\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-socket\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183412    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-credential-socket\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183456    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-envoy\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-certs\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183870 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183843    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-data\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.183946 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-certs\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.184003 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.183969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-socket\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.184075 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.184049    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-credential-socket\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.184139 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.184056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istiod-ca-cert\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.185985 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.185965    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-envoy\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.186190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.186171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-podinfo\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.192836 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.192807    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-token\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.193087 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.193063    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fntvg\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-kube-api-access-fntvg\") pod \"e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") " pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.307585 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.307504    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:30.346159 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.346127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:30.455670 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.455641    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"]
Jul 28 21:26:30.457228 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:26:30.457202    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e3b49f_dccd_4cd9_b634_5dedd0bcf855.slice/crio-08c0e4d815237de5fa5031f7afcf0726bfb3a6aca34890d875fe9c3150268e0b WatchSource:0}: Error finding container 08c0e4d815237de5fa5031f7afcf0726bfb3a6aca34890d875fe9c3150268e0b: Status 404 returned error can't find the container with id 08c0e4d815237de5fa5031f7afcf0726bfb3a6aca34890d875fe9c3150268e0b
Jul 28 21:26:30.459284 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.459245    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:30.459384 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.459315    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:30.459384 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:30.459344    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:31.022793 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:31.022734    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" event={"ID":"06e3b49f-dccd-4cd9-b634-5dedd0bcf855","Type":"ContainerStarted","Data":"4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70"}
Jul 28 21:26:31.023189 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:31.022815    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" event={"ID":"06e3b49f-dccd-4cd9-b634-5dedd0bcf855","Type":"ContainerStarted","Data":"08c0e4d815237de5fa5031f7afcf0726bfb3a6aca34890d875fe9c3150268e0b"}
Jul 28 21:26:31.047772 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:31.047710    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podStartSLOduration=2.047689117 podStartE2EDuration="2.047689117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:26:31.04585992 +0000 UTC m=+2495.880103509" watchObservedRunningTime="2026-07-28 21:26:31.047689117 +0000 UTC m=+2495.881932704"
Jul 28 21:26:31.308519 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:31.308427    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:31.310243 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:31.310217    2572 patch_prober.go:28] interesting pod/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 21:26:31.310356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:31.310270    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 21:26:32.313377 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:32.313342    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:33.013486 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:33.013457    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:33.033393 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:33.033363    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:33.034370 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:33.034350    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:33.112336 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:33.112308    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:33.336617 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:33.336518    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:33.643168 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:33.643135    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:33.983760 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:33.983641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:34.076045 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.075997    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:34.156492 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.156462    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"]
Jul 28 21:26:34.156906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.156890    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy"
Jul 28 21:26:34.156995 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.156908    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy"
Jul 28 21:26:34.157069 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.157020    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd1aef8-3bf2-4f29-adcd-5df87684d0c6" containerName="istio-proxy"
Jul 28 21:26:34.159992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.159972    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.162634 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.162611    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-b439d9-dockercfg-vjt55\""
Jul 28 21:26:34.162724 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.162621    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-b439d9\""
Jul 28 21:26:34.177826 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.169995    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"]
Jul 28 21:26:34.219849 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.219811    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.220037 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.219943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmmwz\" (UniqueName: \"kubernetes.io/projected/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-kube-api-access-zmmwz\") pod \"payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.242881 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.242847    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"]
Jul 28 21:26:34.246408 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.246387    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.261727 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.261684    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"]
Jul 28 21:26:34.320630 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.320599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.320828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.320647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmmwz\" (UniqueName: \"kubernetes.io/projected/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-kube-api-access-zmmwz\") pod \"payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.320828 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.320801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.320945 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.320846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98lhf\" (UniqueName: \"kubernetes.io/projected/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-kube-api-access-98lhf\") pod \"payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.321521 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.321503    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.327904 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.327878    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:26:34.329239 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.329214    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmmwz\" (UniqueName: \"kubernetes.io/projected/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-kube-api-access-zmmwz\") pod \"payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.421889 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.421851    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-certs\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.421889 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.421897    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-envoy\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.421932    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-token\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.421957    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-socket\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.421986    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-podinfo\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422011    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istiod-ca-cert\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422052    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-credential-socket\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422105    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-data\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422137    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58q6j\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-kube-api-access-58q6j\") pod \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\" (UID: \"4ba67fe3-e139-4ef2-ab44-4692d9da177e\") "
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422206    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422302    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98lhf\" (UniqueName: \"kubernetes.io/projected/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-kube-api-access-98lhf\") pod \"payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.422447 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422387    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:34.423041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422475    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.423041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422623    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.423041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422644    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.423041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422657    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.423041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.422907    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:26:34.423254 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.423103    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:34.423658 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.423637    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.424550 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.424525    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:26:34.424660 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.424555    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-kube-api-access-58q6j" (OuterVolumeSpecName: "kube-api-access-58q6j") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "kube-api-access-58q6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:26:34.424820 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.424805    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:26:34.424951 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.424931    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ba67fe3-e139-4ef2-ab44-4692d9da177e" (UID: "4ba67fe3-e139-4ef2-ab44-4692d9da177e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:26:34.434480 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.434451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98lhf\" (UniqueName: \"kubernetes.io/projected/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-kube-api-access-98lhf\") pod \"payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.485234 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.485140    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:34.523884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.523850    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.523884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.523881    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.523884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.523895    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.524144 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.523908    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.524144 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.523919    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ba67fe3-e139-4ef2-ab44-4692d9da177e-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.524144 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.523930    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58q6j\" (UniqueName: \"kubernetes.io/projected/4ba67fe3-e139-4ef2-ab44-4692d9da177e-kube-api-access-58q6j\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:26:34.559846 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.559814    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:34.631594 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.631507    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"]
Jul 28 21:26:34.636073 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:26:34.636040    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb0a3af_e66c_4419_abe5_a3e171a9ec09.slice/crio-388b633ec9a8985474e8eabd6eca24c195f2a7ba4f0358e8bfeb67a930c64721 WatchSource:0}: Error finding container 388b633ec9a8985474e8eabd6eca24c195f2a7ba4f0358e8bfeb67a930c64721: Status 404 returned error can't find the container with id 388b633ec9a8985474e8eabd6eca24c195f2a7ba4f0358e8bfeb67a930c64721
Jul 28 21:26:34.718900 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:34.718743    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"]
Jul 28 21:26:34.721807 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:26:34.721752    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d153df_aca1_4862_8c4d_2f9e9a8ce1fe.slice/crio-45c2e80f45c17d7f8578e792ce29d5cd6919726cd5273dd6f4b88ae55859b6e9 WatchSource:0}: Error finding container 45c2e80f45c17d7f8578e792ce29d5cd6919726cd5273dd6f4b88ae55859b6e9: Status 404 returned error can't find the container with id 45c2e80f45c17d7f8578e792ce29d5cd6919726cd5273dd6f4b88ae55859b6e9
Jul 28 21:26:35.044861 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.044728    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5" event={"ID":"9fb0a3af-e66c-4419-abe5-a3e171a9ec09","Type":"ContainerStarted","Data":"8a9586af363d68860e523372ea9808d8f1f45e7189aa94f1f0f67430e69b544c"}
Jul 28 21:26:35.045040 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.044952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:35.045040 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.044994    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5" event={"ID":"9fb0a3af-e66c-4419-abe5-a3e171a9ec09","Type":"ContainerStarted","Data":"388b633ec9a8985474e8eabd6eca24c195f2a7ba4f0358e8bfeb67a930c64721"}
Jul 28 21:26:35.046451 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.046427    2572 generic.go:356] "Generic (PLEG): container finished" podID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerID="0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655" exitCode=0
Jul 28 21:26:35.046566 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.046465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" event={"ID":"4ba67fe3-e139-4ef2-ab44-4692d9da177e","Type":"ContainerDied","Data":"0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655"}
Jul 28 21:26:35.046566 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.046512    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59" event={"ID":"4ba67fe3-e139-4ef2-ab44-4692d9da177e","Type":"ContainerDied","Data":"957370e8cd80353e9def26b209c0806117cadbc38b0df557c2a306340017fe4e"}
Jul 28 21:26:35.046566 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.046536    2572 scope.go:117] "RemoveContainer" containerID="0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655"
Jul 28 21:26:35.046566 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.046473    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"
Jul 28 21:26:35.048940 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.048909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84" event={"ID":"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe","Type":"ContainerStarted","Data":"40d68a3dbde3e237ccfcc4aeaef28d72d8c31b1ef60a4d78baaeceba2fc032a3"}
Jul 28 21:26:35.049055 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.048976    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84" event={"ID":"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe","Type":"ContainerStarted","Data":"45c2e80f45c17d7f8578e792ce29d5cd6919726cd5273dd6f4b88ae55859b6e9"}
Jul 28 21:26:35.059691 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.059665    2572 scope.go:117] "RemoveContainer" containerID="1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef"
Jul 28 21:26:35.064716 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.064672    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5" podStartSLOduration=1.064659303 podStartE2EDuration="1.064659303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:26:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:26:35.06283558 +0000 UTC m=+2499.897079170" watchObservedRunningTime="2026-07-28 21:26:35.064659303 +0000 UTC m=+2499.898902889"
Jul 28 21:26:35.084392 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.084331    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84" podStartSLOduration=1.084309063 podStartE2EDuration="1.084309063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:26:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:26:35.083454526 +0000 UTC m=+2499.917698114" watchObservedRunningTime="2026-07-28 21:26:35.084309063 +0000 UTC m=+2499.918552653"
Jul 28 21:26:35.084645 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.084417    2572 scope.go:117] "RemoveContainer" containerID="0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655"
Jul 28 21:26:35.085129 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:26:35.085107    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655\": container with ID starting with 0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655 not found: ID does not exist" containerID="0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655"
Jul 28 21:26:35.085225 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.085147    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655"} err="failed to get container status \"0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655\": rpc error: code = NotFound desc = could not find container \"0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655\": container with ID starting with 0b8bd0b4b47045babe8154fa23d117e849ebe4c6a84de149bac365eba627e655 not found: ID does not exist"
Jul 28 21:26:35.085225 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.085168    2572 scope.go:117] "RemoveContainer" containerID="1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef"
Jul 28 21:26:35.085495 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:26:35.085478    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef\": container with ID starting with 1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef not found: ID does not exist" containerID="1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef"
Jul 28 21:26:35.085551 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.085505    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef"} err="failed to get container status \"1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef\": rpc error: code = NotFound desc = could not find container \"1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef\": container with ID starting with 1fe490982387a01b709be749de33ae886954aee0eec460d176d709994505a7ef not found: ID does not exist"
Jul 28 21:26:35.099178 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.099132    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"]
Jul 28 21:26:35.103284 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.103253    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59"]
Jul 28 21:26:35.718351 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:35.718315    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" path="/var/lib/kubelet/pods/4ba67fe3-e139-4ef2-ab44-4692d9da177e/volumes"
Jul 28 21:26:36.055291 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:36.055203    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:46.056915 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:46.056863    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5" podUID="9fb0a3af-e66c-4419-abe5-a3e171a9ec09" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.69:9004: connect: connection refused"
Jul 28 21:26:46.129611 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:46.129532    2572 generic.go:356] "Generic (PLEG): container finished" podID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerID="4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70" exitCode=0
Jul 28 21:26:46.129611 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:46.129588    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" event={"ID":"06e3b49f-dccd-4cd9-b634-5dedd0bcf855","Type":"ContainerDied","Data":"4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70"}
Jul 28 21:26:46.130006 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:46.129991    2572 scope.go:117] "RemoveContainer" containerID="4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70"
Jul 28 21:26:46.131059 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:46.131029    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:46.131127 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:46.131103    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:46.131168 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:46.131137    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:47.062521 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:47.062485    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:26:47.138122 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:47.138092    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" event={"ID":"06e3b49f-dccd-4cd9-b634-5dedd0bcf855","Type":"ContainerStarted","Data":"65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222"}
Jul 28 21:26:47.307880 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:47.307838    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:47.309314 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:47.309280    2572 patch_prober.go:28] interesting pod/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 21:26:47.309474 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:47.309335    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 21:26:48.033978 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:48.033940    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:48.308199 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:48.308092    2572 patch_prober.go:28] interesting pod/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 21:26:48.308199 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:48.308163    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 21:26:49.308318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:49.308278    2572 patch_prober.go:28] interesting pod/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 21:26:49.308727 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:49.308333    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 21:26:50.307988 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:50.307949    2572 patch_prober.go:28] interesting pod/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 21:26:50.308185 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:50.308012    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 21:26:51.312544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:51.312509    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:51.313494 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:51.313476    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:26:56.056254 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:56.056226    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:26:58.078520 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.078486    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:58.451495 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.451457    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:58.830176 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.830093    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"]
Jul 28 21:26:58.830809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.830643    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy"
Jul 28 21:26:58.830809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.830668    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy"
Jul 28 21:26:58.830809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.830679    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy"
Jul 28 21:26:58.830809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.830685    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy"
Jul 28 21:26:58.830809 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.830806    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy"
Jul 28 21:26:58.836018 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.835992    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.838899 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.838873    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-7076b1-openshift-default-dockercfg-vmn28\""
Jul 28 21:26:58.846093 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.846067    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"]
Jul 28 21:26:58.854083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.854060    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:58.958695 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-credential-socket\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.958897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-podinfo\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.958897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb5r5\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-kube-api-access-gb5r5\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.958897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958845    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istiod-ca-cert\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.958897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958873    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-token\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.958897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958888    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-envoy\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.959079 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-certs\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.959079 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.958980    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-data\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:58.959079 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:58.959021    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-socket\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060250 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istiod-ca-cert\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060250 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060252    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-token\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-envoy\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-certs\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-data\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060375    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-socket\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060412    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-credential-socket\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-podinfo\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060817 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060511    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb5r5\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-kube-api-access-gb5r5\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060893 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-certs\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.060952 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060932    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-socket\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.061013 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.060982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-credential-socket\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.061066 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.061013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-data\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.061104 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.061063    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istiod-ca-cert\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.062753 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.062733    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-envoy\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.063232 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.063212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-podinfo\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.068620 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.068572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:26:59.068749 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.068707    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb5r5\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-kube-api-access-gb5r5\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.068895 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.068879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-token\") pod \"e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") " pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.148652 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.148615    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:26:59.292833 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.292808    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"]
Jul 28 21:26:59.294456 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:26:59.294425    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7193ef37_66ee_4c7a_99ad_f0cb7842d47d.slice/crio-41943ad24d4b51c8690e9df3e197dc491a1f84ddc80aa65fb67b55c269186056 WatchSource:0}: Error finding container 41943ad24d4b51c8690e9df3e197dc491a1f84ddc80aa65fb67b55c269186056: Status 404 returned error can't find the container with id 41943ad24d4b51c8690e9df3e197dc491a1f84ddc80aa65fb67b55c269186056
Jul 28 21:26:59.296714 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.296681    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:59.296837 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.296758    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:26:59.296837 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:26:59.296823    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:27:00.202889 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:00.202853    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" event={"ID":"7193ef37-66ee-4c7a-99ad-f0cb7842d47d","Type":"ContainerStarted","Data":"190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a"}
Jul 28 21:27:00.203322 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:00.202909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" event={"ID":"7193ef37-66ee-4c7a-99ad-f0cb7842d47d","Type":"ContainerStarted","Data":"41943ad24d4b51c8690e9df3e197dc491a1f84ddc80aa65fb67b55c269186056"}
Jul 28 21:27:00.223285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:00.223237    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" podStartSLOduration=2.22322272 podStartE2EDuration="2.22322272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:26:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:27:00.221603193 +0000 UTC m=+2525.055846780" watchObservedRunningTime="2026-07-28 21:27:00.22322272 +0000 UTC m=+2525.057466375"
Jul 28 21:27:01.149321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:01.149274    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:01.154763 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:01.154737    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:01.207843 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:01.207809    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:01.209009 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:01.208988    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:02.197746 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:02.197686    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:27:02.275552 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:02.275520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:27:02.348092 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:02.348028    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:27:02.448184 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:02.448071    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:27:02.806298 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:02.806210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:27:02.909497 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:02.909470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:27:17.249023 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:17.248979    2572 patch_prober.go:28] interesting pod/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 21:27:17.249533 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:17.249063    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 21:27:18.293990 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:18.293897    2572 generic.go:356] "Generic (PLEG): container finished" podID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerID="190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a" exitCode=0
Jul 28 21:27:18.293990 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:18.293978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" event={"ID":"7193ef37-66ee-4c7a-99ad-f0cb7842d47d","Type":"ContainerDied","Data":"190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a"}
Jul 28 21:27:18.294427 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:18.294350    2572 scope.go:117] "RemoveContainer" containerID="190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a"
Jul 28 21:27:18.295321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:18.295296    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:27:18.295398 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:18.295385    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:27:18.295444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:18.295433    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:27:19.303345 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:19.303311    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" event={"ID":"7193ef37-66ee-4c7a-99ad-f0cb7842d47d","Type":"ContainerStarted","Data":"c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61"}
Jul 28 21:27:20.149536 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:20.149492    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:20.149940 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:20.149917    2572 patch_prober.go:28] interesting pod/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 21:27:20.150001 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:20.149966    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 21:27:21.149268 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:21.149233    2572 patch_prober.go:28] interesting pod/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 21:27:21.149674 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:21.149286    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 21:27:22.149151 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:22.149114    2572 patch_prober.go:28] interesting pod/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 21:27:22.149343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:22.149174    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 21:27:23.153066 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:23.153035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:23.153547 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:23.153313    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:23.154066 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:23.154049    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:27:27.280259 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:27.280224    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:27:40.458763 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:27:40.458728    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:28:22.864378 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:28:22.864296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:29:39.696008 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:29:39.695976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:29:41.067360 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:29:41.067320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:29:55.851710 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:29:55.851629    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:29:55.853889 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:29:55.853863    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:30:00.141448 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.141332    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"]
Jul 28 21:30:00.142041 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.142022    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba67fe3-e139-4ef2-ab44-4692d9da177e" containerName="istio-proxy"
Jul 28 21:30:00.145075 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.145055    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"]
Jul 28 21:30:00.145226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.145190    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"
Jul 28 21:30:00.147883 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.147848    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wt6gl\""
Jul 28 21:30:00.148315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.148300    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"
Jul 28 21:30:00.156609 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.156583    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"]
Jul 28 21:30:00.159105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.159080    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"
Jul 28 21:30:00.159558 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.159536    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"]
Jul 28 21:30:00.166726 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.166701    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"
Jul 28 21:30:00.352123 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.352073    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"]
Jul 28 21:30:00.353257 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:30:00.353225    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c31530_b0cd_4801_8d1f_6670380d16b3.slice/crio-e74cff5b425fee1bfb612ea87b44d5baedc834410f4b91071dfb929b73b85c94 WatchSource:0}: Error finding container e74cff5b425fee1bfb612ea87b44d5baedc834410f4b91071dfb929b73b85c94: Status 404 returned error can't find the container with id e74cff5b425fee1bfb612ea87b44d5baedc834410f4b91071dfb929b73b85c94
Jul 28 21:30:00.531773 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:00.531743    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"]
Jul 28 21:30:00.533359 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:30:00.533327    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76d6552_efe2_48e4_a600_fe667db57ab9.slice/crio-a313938fa9eab86bca41e71fcf7dc80a7e754e520f3e524e6e9ca5dc9164d073 WatchSource:0}: Error finding container a313938fa9eab86bca41e71fcf7dc80a7e754e520f3e524e6e9ca5dc9164d073: Status 404 returned error can't find the container with id a313938fa9eab86bca41e71fcf7dc80a7e754e520f3e524e6e9ca5dc9164d073
Jul 28 21:30:01.106340 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:01.106237    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj" event={"ID":"f2c31530-b0cd-4801-8d1f-6670380d16b3","Type":"ContainerStarted","Data":"2d70ab549ce454c0be79b5f140a0cd0d2c1a37b550b859b4d6ebdb566c01bafb"}
Jul 28 21:30:01.106340 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:01.106294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj" event={"ID":"f2c31530-b0cd-4801-8d1f-6670380d16b3","Type":"ContainerStarted","Data":"e74cff5b425fee1bfb612ea87b44d5baedc834410f4b91071dfb929b73b85c94"}
Jul 28 21:30:01.107737 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:01.107711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp" event={"ID":"f76d6552-efe2-48e4-a600-fe667db57ab9","Type":"ContainerStarted","Data":"3a7e3006106ad338392703f1bbdb85e37c7c5cd8c3e8717899189dd9054c72d6"}
Jul 28 21:30:01.107915 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:01.107752    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp" event={"ID":"f76d6552-efe2-48e4-a600-fe667db57ab9","Type":"ContainerStarted","Data":"a313938fa9eab86bca41e71fcf7dc80a7e754e520f3e524e6e9ca5dc9164d073"}
Jul 28 21:30:01.129825 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:01.129744    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj" podStartSLOduration=1.129725957 podStartE2EDuration="1.129725957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:30:01.128055914 +0000 UTC m=+2705.962299501" watchObservedRunningTime="2026-07-28 21:30:01.129725957 +0000 UTC m=+2705.963969543"
Jul 28 21:30:01.145896 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:01.145809    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp" podStartSLOduration=1.145769561 podStartE2EDuration="1.145769561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:30:01.144463678 +0000 UTC m=+2705.978707265" watchObservedRunningTime="2026-07-28 21:30:01.145769561 +0000 UTC m=+2705.980013147"
Jul 28 21:30:02.116294 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:02.116256    2572 generic.go:356] "Generic (PLEG): container finished" podID="f2c31530-b0cd-4801-8d1f-6670380d16b3" containerID="2d70ab549ce454c0be79b5f140a0cd0d2c1a37b550b859b4d6ebdb566c01bafb" exitCode=0
Jul 28 21:30:02.116492 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:02.116346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj" event={"ID":"f2c31530-b0cd-4801-8d1f-6670380d16b3","Type":"ContainerDied","Data":"2d70ab549ce454c0be79b5f140a0cd0d2c1a37b550b859b4d6ebdb566c01bafb"}
Jul 28 21:30:02.117862 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:02.117834    2572 generic.go:356] "Generic (PLEG): container finished" podID="f76d6552-efe2-48e4-a600-fe667db57ab9" containerID="3a7e3006106ad338392703f1bbdb85e37c7c5cd8c3e8717899189dd9054c72d6" exitCode=0
Jul 28 21:30:02.117998 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:02.117929    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp" event={"ID":"f76d6552-efe2-48e4-a600-fe667db57ab9","Type":"ContainerDied","Data":"3a7e3006106ad338392703f1bbdb85e37c7c5cd8c3e8717899189dd9054c72d6"}
Jul 28 21:30:03.280720 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:03.280680    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"
Jul 28 21:30:03.284140 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:03.284118    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"
Jul 28 21:30:04.129042 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:04.129015    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"
Jul 28 21:30:04.129233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:04.129011    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj" event={"ID":"f2c31530-b0cd-4801-8d1f-6670380d16b3","Type":"ContainerDied","Data":"e74cff5b425fee1bfb612ea87b44d5baedc834410f4b91071dfb929b73b85c94"}
Jul 28 21:30:04.129233 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:04.129141    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e74cff5b425fee1bfb612ea87b44d5baedc834410f4b91071dfb929b73b85c94"
Jul 28 21:30:04.130395 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:04.130372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp" event={"ID":"f76d6552-efe2-48e4-a600-fe667db57ab9","Type":"ContainerDied","Data":"a313938fa9eab86bca41e71fcf7dc80a7e754e520f3e524e6e9ca5dc9164d073"}
Jul 28 21:30:04.130519 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:04.130405    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"
Jul 28 21:30:04.130519 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:30:04.130411    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a313938fa9eab86bca41e71fcf7dc80a7e754e520f3e524e6e9ca5dc9164d073"
Jul 28 21:31:07.730368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:31:07.730319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:32:10.443161 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:10.443102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:32:10.496019 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:10.495985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:32:36.980321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:36.980251    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:32:37.846849 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:37.846773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:32:51.528904 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.528869    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"]
Jul 28 21:32:51.529455 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.529349    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c31530-b0cd-4801-8d1f-6670380d16b3" containerName="cleanup"
Jul 28 21:32:51.529455 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.529363    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c31530-b0cd-4801-8d1f-6670380d16b3" containerName="cleanup"
Jul 28 21:32:51.529455 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.529379    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f76d6552-efe2-48e4-a600-fe667db57ab9" containerName="cleanup"
Jul 28 21:32:51.529455 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.529384    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f76d6552-efe2-48e4-a600-fe667db57ab9" containerName="cleanup"
Jul 28 21:32:51.529656 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.529472    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c31530-b0cd-4801-8d1f-6670380d16b3" containerName="cleanup"
Jul 28 21:32:51.529656 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.529483    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f76d6552-efe2-48e4-a600-fe667db57ab9" containerName="cleanup"
Jul 28 21:32:51.532481 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.532466    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.535262 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.535243    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b439d9\"/\"kube-root-ca.crt\""
Jul 28 21:32:51.536247 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.536232    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b439d9\"/\"default-dockercfg-jh228\""
Jul 28 21:32:51.536321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.536252    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b439d9\"/\"openshift-service-ca.crt\""
Jul 28 21:32:51.536367 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.536340    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b439d9\"/\"sub-test-model-b439d9-kserve-self-signed-certs\""
Jul 28 21:32:51.544846 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.544821    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"]
Jul 28 21:32:51.555945 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.555917    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:32:51.620108 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.620066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-dshm\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.620307 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.620130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-home\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.620307 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.620171    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tmp-dir\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.620307 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.620199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-model-cache\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.620307 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.620220    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tls-certs\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.620307 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.620235    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlh62\" (UniqueName: \"kubernetes.io/projected/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-kube-api-access-dlh62\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721016 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.720986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tls-certs\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721016 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.721027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlh62\" (UniqueName: \"kubernetes.io/projected/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-kube-api-access-dlh62\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721299 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.721139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-dshm\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721299 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.721189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-home\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721299 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.721222    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tmp-dir\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721299 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.721259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-model-cache\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721672 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.721643    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-model-cache\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.721964 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.721936    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-home\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.722244 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.722219    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tmp-dir\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.725545 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.725510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-dshm\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.725798 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.725753    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tls-certs\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.731472 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.731449    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlh62\" (UniqueName: \"kubernetes.io/projected/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-kube-api-access-dlh62\") pod \"sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") " pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.842268 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.842180    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:32:51.994423 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:51.994398    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"]
Jul 28 21:32:51.996487 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:32:51.996462    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded59a0cf_7f32_49e2_b7c6_4adef88dd550.slice/crio-95a7ddacaf618d17305d494c9092bddb5f029441a9af45c99fad40972dde77fb WatchSource:0}: Error finding container 95a7ddacaf618d17305d494c9092bddb5f029441a9af45c99fad40972dde77fb: Status 404 returned error can't find the container with id 95a7ddacaf618d17305d494c9092bddb5f029441a9af45c99fad40972dde77fb
Jul 28 21:32:52.009928 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:52.009900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:32:52.993597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:52.993557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg" event={"ID":"ed59a0cf-7f32-49e2-b7c6-4adef88dd550","Type":"ContainerStarted","Data":"17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172"}
Jul 28 21:32:52.993597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:52.993602    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg" event={"ID":"ed59a0cf-7f32-49e2-b7c6-4adef88dd550","Type":"ContainerStarted","Data":"95a7ddacaf618d17305d494c9092bddb5f029441a9af45c99fad40972dde77fb"}
Jul 28 21:32:53.013470 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:32:53.013420    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg" podStartSLOduration=2.013406177 podStartE2EDuration="2.013406177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:32:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:32:53.010964385 +0000 UTC m=+2877.845207972" watchObservedRunningTime="2026-07-28 21:32:53.013406177 +0000 UTC m=+2877.847649768"
Jul 28 21:33:01.842630 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:33:01.842597    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:33:01.843061 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:33:01.842647    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:33:01.855680 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:33:01.855657    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:33:02.054681 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:33:02.054650    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:33:33.030358 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:33:33.030318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:34:32.645408 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:32.645314    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"]
Jul 28 21:34:32.666393 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:32.666363    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:34:33.459391 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:33.459352    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:34:47.666333 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:47.666291    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg" podUID="ed59a0cf-7f32-49e2-b7c6-4adef88dd550" containerName="main" containerID="cri-o://17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172" gracePeriod=45
Jul 28 21:34:47.921295 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:47.921221    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:34:48.087734 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.087702    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlh62\" (UniqueName: \"kubernetes.io/projected/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-kube-api-access-dlh62\") pod \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") "
Jul 28 21:34:48.087967 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.087770    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-model-cache\") pod \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") "
Jul 28 21:34:48.087967 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.087837    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tmp-dir\") pod \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") "
Jul 28 21:34:48.088105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.087991    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tls-certs\") pod \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") "
Jul 28 21:34:48.088105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088028    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-home\") pod \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") "
Jul 28 21:34:48.088105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088066    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed59a0cf-7f32-49e2-b7c6-4adef88dd550" (UID: "ed59a0cf-7f32-49e2-b7c6-4adef88dd550"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:34:48.088105 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088080    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed59a0cf-7f32-49e2-b7c6-4adef88dd550" (UID: "ed59a0cf-7f32-49e2-b7c6-4adef88dd550"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:34:48.088306 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088099    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-dshm\") pod \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\" (UID: \"ed59a0cf-7f32-49e2-b7c6-4adef88dd550\") "
Jul 28 21:34:48.088306 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088254    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-home" (OuterVolumeSpecName: "home") pod "ed59a0cf-7f32-49e2-b7c6-4adef88dd550" (UID: "ed59a0cf-7f32-49e2-b7c6-4adef88dd550"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:34:48.088413 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088395    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-model-cache\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:34:48.088413 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088407    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tmp-dir\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:34:48.088413 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.088414    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-home\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:34:48.090213 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.090184    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed59a0cf-7f32-49e2-b7c6-4adef88dd550" (UID: "ed59a0cf-7f32-49e2-b7c6-4adef88dd550"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:34:48.090321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.090224    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-dshm" (OuterVolumeSpecName: "dshm") pod "ed59a0cf-7f32-49e2-b7c6-4adef88dd550" (UID: "ed59a0cf-7f32-49e2-b7c6-4adef88dd550"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:34:48.090321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.090265    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-kube-api-access-dlh62" (OuterVolumeSpecName: "kube-api-access-dlh62") pod "ed59a0cf-7f32-49e2-b7c6-4adef88dd550" (UID: "ed59a0cf-7f32-49e2-b7c6-4adef88dd550"). InnerVolumeSpecName "kube-api-access-dlh62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:34:48.189089 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.188996    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-dshm\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:34:48.189089 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.189028    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlh62\" (UniqueName: \"kubernetes.io/projected/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-kube-api-access-dlh62\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:34:48.189089 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.189040    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed59a0cf-7f32-49e2-b7c6-4adef88dd550-tls-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:34:48.590538 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.590445    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed59a0cf-7f32-49e2-b7c6-4adef88dd550" containerID="17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172" exitCode=0
Jul 28 21:34:48.590538 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.590488    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"
Jul 28 21:34:48.590734 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.590487    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg" event={"ID":"ed59a0cf-7f32-49e2-b7c6-4adef88dd550","Type":"ContainerDied","Data":"17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172"}
Jul 28 21:34:48.590734 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.590612    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg" event={"ID":"ed59a0cf-7f32-49e2-b7c6-4adef88dd550","Type":"ContainerDied","Data":"95a7ddacaf618d17305d494c9092bddb5f029441a9af45c99fad40972dde77fb"}
Jul 28 21:34:48.590734 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.590636    2572 scope.go:117] "RemoveContainer" containerID="17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172"
Jul 28 21:34:48.599932 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.599914    2572 scope.go:117] "RemoveContainer" containerID="17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172"
Jul 28 21:34:48.600199 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:34:48.600177    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172\": container with ID starting with 17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172 not found: ID does not exist" containerID="17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172"
Jul 28 21:34:48.600263 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.600212    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172"} err="failed to get container status \"17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172\": rpc error: code = NotFound desc = could not find container \"17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172\": container with ID starting with 17650e12cb983cd4951f0d01e4e0263208cd61fdf8850e60f7a3df89c4e61172 not found: ID does not exist"
Jul 28 21:34:48.612320 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.612291    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"]
Jul 28 21:34:48.614248 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:48.614226    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b439d9/sub-test-model-b439d9-kserve-5ddc6bbbd5-g6bsg"]
Jul 28 21:34:49.717482 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:49.717446    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed59a0cf-7f32-49e2-b7c6-4adef88dd550" path="/var/lib/kubelet/pods/ed59a0cf-7f32-49e2-b7c6-4adef88dd550/volumes"
Jul 28 21:34:50.269445 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:50.269410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:34:55.883598 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:55.883563    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:34:55.885911 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:34:55.885886    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:35:31.065712 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:35:31.065671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:36:14.618419 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:36:14.618378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:36:39.534649 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:36:39.534612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:36:40.351677 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:36:40.351636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:00.114228 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.114192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:00.391171 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.391139    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"]
Jul 28 21:37:00.391623 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.391606    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed59a0cf-7f32-49e2-b7c6-4adef88dd550" containerName="main"
Jul 28 21:37:00.391729 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.391627    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed59a0cf-7f32-49e2-b7c6-4adef88dd550" containerName="main"
Jul 28 21:37:00.391729 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.391706    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed59a0cf-7f32-49e2-b7c6-4adef88dd550" containerName="main"
Jul 28 21:37:00.395046 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.395024    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.397651 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.397630    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-7aec84-openshift-default-dockercfg-q2b4x\""
Jul 28 21:37:00.407183 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.407163    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"]
Jul 28 21:37:00.419261 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.419228    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:00.480426 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-certs\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480426 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d5422e-a9a7-4ce2-a502-f911efa52a94-istiod-ca-cert\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-token\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480539    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-socket\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480575    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-credential-socket\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480620    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-envoy\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8nrc\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-kube-api-access-j8nrc\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480660    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-data\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.480923 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.480724    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-podinfo\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581240 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-data\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-podinfo\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-certs\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d5422e-a9a7-4ce2-a502-f911efa52a94-istiod-ca-cert\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581428 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-token\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581429    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-socket\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-credential-socket\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581504    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-envoy\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581544    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nrc\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-kube-api-access-j8nrc\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581694    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-data\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581731    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-certs\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.581905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581774    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-credential-socket\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.582076 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.581967    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-socket\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.582422 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.582376    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d5422e-a9a7-4ce2-a502-f911efa52a94-istiod-ca-cert\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.584131 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.584100    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-podinfo\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.584131 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.584115    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-envoy\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.594261 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.594227    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-token\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.594441 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.594397    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8nrc\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-kube-api-access-j8nrc\") pod \"e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") " pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.629623 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.629579    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:00.705731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.705650    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:00.855469 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.855442    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"]
Jul 28 21:37:00.856566 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:37:00.856539    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d5422e_a9a7_4ce2_a502_f911efa52a94.slice/crio-28ce76d6ac525cd5eae3882bca3d54ca126a2eef3fdaaa3f2f76485f369ba850 WatchSource:0}: Error finding container 28ce76d6ac525cd5eae3882bca3d54ca126a2eef3fdaaa3f2f76485f369ba850: Status 404 returned error can't find the container with id 28ce76d6ac525cd5eae3882bca3d54ca126a2eef3fdaaa3f2f76485f369ba850
Jul 28 21:37:00.858596 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.858568    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:37:00.858664 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.858637    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:37:00.858701 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:00.858665    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:37:01.269824 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:01.269767    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" event={"ID":"35d5422e-a9a7-4ce2-a502-f911efa52a94","Type":"ContainerStarted","Data":"40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a"}
Jul 28 21:37:01.270237 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:01.269847    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" event={"ID":"35d5422e-a9a7-4ce2-a502-f911efa52a94","Type":"ContainerStarted","Data":"28ce76d6ac525cd5eae3882bca3d54ca126a2eef3fdaaa3f2f76485f369ba850"}
Jul 28 21:37:01.292802 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:01.292728    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" podStartSLOduration=1.292714734 podStartE2EDuration="1.292714734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:37:01.291099776 +0000 UTC m=+3126.125343362" watchObservedRunningTime="2026-07-28 21:37:01.292714734 +0000 UTC m=+3126.126958319"
Jul 28 21:37:01.706142 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:01.706104    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:01.717496 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:01.717470    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:02.278050 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:02.278015    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:02.282647 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:02.282619    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:03.268318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:03.268286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:03.425998 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:03.425959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:03.592083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:03.591993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:03.691711 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:03.691673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:04.058128 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.058078    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:04.155525 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.155494    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:04.157984 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.157957    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"]
Jul 28 21:37:04.162338 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.162315    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.164911 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.164889    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-7aec84\""
Jul 28 21:37:04.165031 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.164942    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-7aec84-dockercfg-fxqnx\""
Jul 28 21:37:04.173613 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.173585    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"]
Jul 28 21:37:04.177073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.177046    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"]
Jul 28 21:37:04.181358 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.181333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.187615 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.187584    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"]
Jul 28 21:37:04.218226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.218187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91995ff7-585a-4eba-8b55-5926aa962da0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.218414 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.218267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hwvl\" (UniqueName: \"kubernetes.io/projected/91995ff7-585a-4eba-8b55-5926aa962da0-kube-api-access-2hwvl\") pod \"payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.318914 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.318811    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m4lt\" (UniqueName: \"kubernetes.io/projected/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-kube-api-access-4m4lt\") pod \"payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.318914 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.318878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91995ff7-585a-4eba-8b55-5926aa962da0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.319175 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.318994    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.319175 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.319058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hwvl\" (UniqueName: \"kubernetes.io/projected/91995ff7-585a-4eba-8b55-5926aa962da0-kube-api-access-2hwvl\") pod \"payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.319645 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.319625    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91995ff7-585a-4eba-8b55-5926aa962da0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.327675 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.327643    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hwvl\" (UniqueName: \"kubernetes.io/projected/91995ff7-585a-4eba-8b55-5926aa962da0-kube-api-access-2hwvl\") pod \"payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.419993 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.419946    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.420210 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.420072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m4lt\" (UniqueName: \"kubernetes.io/projected/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-kube-api-access-4m4lt\") pod \"payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.420817 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.420758    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.437891 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.437869    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m4lt\" (UniqueName: \"kubernetes.io/projected/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-kube-api-access-4m4lt\") pod \"payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.477535 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.477499    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:04.495084 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.495052    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:04.638339 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.638252    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"]
Jul 28 21:37:04.640022 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:37:04.639980    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91995ff7_585a_4eba_8b55_5926aa962da0.slice/crio-f71f403b571a85dd455207680ea54d270c7f2dc3f0bfd54bec27094d5be60d50 WatchSource:0}: Error finding container f71f403b571a85dd455207680ea54d270c7f2dc3f0bfd54bec27094d5be60d50: Status 404 returned error can't find the container with id f71f403b571a85dd455207680ea54d270c7f2dc3f0bfd54bec27094d5be60d50
Jul 28 21:37:04.666070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:04.666038    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"]
Jul 28 21:37:04.683123 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:37:04.683084    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f62181_0dfa_4039_b9d2_0bb54f5b07d2.slice/crio-5864a003033caf6073615a70fd43cca4b22e71ae350ec732e94fafc616353be2 WatchSource:0}: Error finding container 5864a003033caf6073615a70fd43cca4b22e71ae350ec732e94fafc616353be2: Status 404 returned error can't find the container with id 5864a003033caf6073615a70fd43cca4b22e71ae350ec732e94fafc616353be2
Jul 28 21:37:05.296544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.296503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6" event={"ID":"90f62181-0dfa-4039-b9d2-0bb54f5b07d2","Type":"ContainerStarted","Data":"fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c"}
Jul 28 21:37:05.296774 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.296566    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6" event={"ID":"90f62181-0dfa-4039-b9d2-0bb54f5b07d2","Type":"ContainerStarted","Data":"5864a003033caf6073615a70fd43cca4b22e71ae350ec732e94fafc616353be2"}
Jul 28 21:37:05.296774 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.296680    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:05.297995 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.297973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm" event={"ID":"91995ff7-585a-4eba-8b55-5926aa962da0","Type":"ContainerStarted","Data":"79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4"}
Jul 28 21:37:05.298073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.298009    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm" event={"ID":"91995ff7-585a-4eba-8b55-5926aa962da0","Type":"ContainerStarted","Data":"f71f403b571a85dd455207680ea54d270c7f2dc3f0bfd54bec27094d5be60d50"}
Jul 28 21:37:05.298130 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.298116    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:05.313957 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.313912    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6" podStartSLOduration=1.313895677 podStartE2EDuration="1.313895677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:37:05.312396464 +0000 UTC m=+3130.146640049" watchObservedRunningTime="2026-07-28 21:37:05.313895677 +0000 UTC m=+3130.148139287"
Jul 28 21:37:05.329939 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:05.329895    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm" podStartSLOduration=1.329879596 podStartE2EDuration="1.329879596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:37:05.328333571 +0000 UTC m=+3130.162577158" watchObservedRunningTime="2026-07-28 21:37:05.329879596 +0000 UTC m=+3130.164123179"
Jul 28 21:37:16.308966 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:16.308870    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:37:16.308966 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:16.308962    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:37:20.381205 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:20.381167    2572 generic.go:356] "Generic (PLEG): container finished" podID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerID="40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a" exitCode=0
Jul 28 21:37:20.381656 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:20.381223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" event={"ID":"35d5422e-a9a7-4ce2-a502-f911efa52a94","Type":"ContainerDied","Data":"40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a"}
Jul 28 21:37:20.381704 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:20.381679    2572 scope.go:117] "RemoveContainer" containerID="40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a"
Jul 28 21:37:20.382824 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:20.382773    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:37:20.382946 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:20.382877    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:37:20.382946 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:20.382910    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:37:21.396918 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:21.396876    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" event={"ID":"35d5422e-a9a7-4ce2-a502-f911efa52a94","Type":"ContainerStarted","Data":"571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880"}
Jul 28 21:37:21.706295 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:21.706196    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:21.706464 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:21.706419    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 28 21:37:21.706507 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:21.706463    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 28 21:37:22.706192 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:22.706156    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 28 21:37:22.706592 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:22.706214    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 28 21:37:23.706806 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:23.706750    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 28 21:37:23.707236 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:23.706834    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 28 21:37:24.706638 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:24.706601    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 28 21:37:24.706865 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:24.706657    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 28 21:37:25.710591 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:25.710561    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:25.720442 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:25.720412    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:25.720624 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:25.720491    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:37:28.277955 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:28.277924    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:28.978222 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:28.978192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:29.285186 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:29.285098    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:29.556909 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:29.556806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:32.263164 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:32.263119    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:32.357529 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:32.357499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:33.522367 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:33.522329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:33.857330 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:33.857230    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:34.122327 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.122295    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:34.190849 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.190808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:34.220624 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.220581    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"]
Jul 28 21:37:34.225271 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.225253    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.227981 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.227952    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-35d85b\""
Jul 28 21:37:34.227981 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.227977    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-35d85b-dockercfg-d6jrq\""
Jul 28 21:37:34.234876 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.234848    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"]
Jul 28 21:37:34.319646 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.319609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fd2c50-0f57-4589-85c9-f88f7e820c84-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.319882 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.319753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h48ql\" (UniqueName: \"kubernetes.io/projected/39fd2c50-0f57-4589-85c9-f88f7e820c84-kube-api-access-h48ql\") pod \"payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.421477 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.421379    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fd2c50-0f57-4589-85c9-f88f7e820c84-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.421683 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.421502    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h48ql\" (UniqueName: \"kubernetes.io/projected/39fd2c50-0f57-4589-85c9-f88f7e820c84-kube-api-access-h48ql\") pod \"payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.422198 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.422180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fd2c50-0f57-4589-85c9-f88f7e820c84-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.430479 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.430452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h48ql\" (UniqueName: \"kubernetes.io/projected/39fd2c50-0f57-4589-85c9-f88f7e820c84-kube-api-access-h48ql\") pod \"payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.538591 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.538559    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:34.682619 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:34.682587    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"]
Jul 28 21:37:34.684869 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:37:34.684830    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fd2c50_0f57_4589_85c9_f88f7e820c84.slice/crio-5d74c6d163745ff6c39beead02843783aa9d3c50df1c0f8de1e7c6caf580de11 WatchSource:0}: Error finding container 5d74c6d163745ff6c39beead02843783aa9d3c50df1c0f8de1e7c6caf580de11: Status 404 returned error can't find the container with id 5d74c6d163745ff6c39beead02843783aa9d3c50df1c0f8de1e7c6caf580de11
Jul 28 21:37:35.471323 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:35.471282    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt" event={"ID":"39fd2c50-0f57-4589-85c9-f88f7e820c84","Type":"ContainerStarted","Data":"57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e"}
Jul 28 21:37:35.471547 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:35.471348    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:35.471547 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:35.471375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt" event={"ID":"39fd2c50-0f57-4589-85c9-f88f7e820c84","Type":"ContainerStarted","Data":"5d74c6d163745ff6c39beead02843783aa9d3c50df1c0f8de1e7c6caf580de11"}
Jul 28 21:37:35.490517 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:35.490462    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt" podStartSLOduration=1.490447009 podStartE2EDuration="1.490447009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:37:35.488278589 +0000 UTC m=+3160.322522188" watchObservedRunningTime="2026-07-28 21:37:35.490447009 +0000 UTC m=+3160.324690595"
Jul 28 21:37:46.479736 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:46.479703    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:37:47.021564 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:47.021525    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:37:54.273841 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:37:54.273812    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt_39fd2c50-0f57-4589-85c9-f88f7e820c84/payload-processing/0.log"
Jul 28 21:38:00.367191 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:00.367154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:32.199401 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:32.199352    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:32.264994 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:32.264955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:40.382425 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:40.382390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:40.482616 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:40.482574    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:46.455407 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:46.455319    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6_90f62181-0dfa-4039-b9d2-0bb54f5b07d2/payload-processing/0.log"
Jul 28 21:38:46.698987 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:46.698955    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt_39fd2c50-0f57-4589-85c9-f88f7e820c84/payload-processing/0.log"
Jul 28 21:38:46.985164 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:46.985126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:47.446405 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.446363    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"]
Jul 28 21:38:47.450021 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.449999    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.453263 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.453241    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-d4bcd2-openshift-default-dockercfg-hktff\""
Jul 28 21:38:47.473138 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.473107    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"]
Jul 28 21:38:47.481140 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.481103    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:47.545123 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzdpk\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-kube-api-access-kzdpk\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545123 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-podinfo\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545398 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-credential-socket\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545398 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545231    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-certs\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545398 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545272    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-socket\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545398 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-data\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545398 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545329    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-token\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545605 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-envoy\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.545605 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.545452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.567356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.567230    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:47.646549 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.646511    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-token\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.646757 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.646589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-envoy\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.646757 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.646609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.646757 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.646634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzdpk\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-kube-api-access-kzdpk\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.646757 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.646652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-podinfo\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647029 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.646861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-credential-socket\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647029 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.646980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-certs\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647029 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.647008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-socket\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647178 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.647042    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-data\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647369 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.647343    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-credential-socket\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.647378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-socket\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647459 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.647415    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-certs\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647572 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.647533    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.647572 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.647547    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-data\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.649841 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.649800    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-envoy\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.649963 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.649945    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-podinfo\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.655165 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.655133    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-token\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.655312 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.655293    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzdpk\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-kube-api-access-kzdpk\") pod \"e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") " pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.760772 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.760680    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:47.905597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.905569    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"]
Jul 28 21:38:47.907739 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:38:47.907712    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf40dbf0_7ea6_45f7_a4e6_515bd0e7e988.slice/crio-3b24b14795f6c8292f206997def926601d0e45e37cd2e2bb8505b2c334e1cd1c WatchSource:0}: Error finding container 3b24b14795f6c8292f206997def926601d0e45e37cd2e2bb8505b2c334e1cd1c: Status 404 returned error can't find the container with id 3b24b14795f6c8292f206997def926601d0e45e37cd2e2bb8505b2c334e1cd1c
Jul 28 21:38:47.910083 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.910041    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:38:47.910154 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.910134    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:38:47.910192 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:47.910177    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:38:48.874843 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:48.874810    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" event={"ID":"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988","Type":"ContainerStarted","Data":"1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc"}
Jul 28 21:38:48.875237 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:48.874862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" event={"ID":"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988","Type":"ContainerStarted","Data":"3b24b14795f6c8292f206997def926601d0e45e37cd2e2bb8505b2c334e1cd1c"}
Jul 28 21:38:48.896733 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:48.896677    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" podStartSLOduration=1.89665238 podStartE2EDuration="1.89665238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:38:48.89560762 +0000 UTC m=+3233.729851206" watchObservedRunningTime="2026-07-28 21:38:48.89665238 +0000 UTC m=+3233.730895967"
Jul 28 21:38:49.761657 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:49.761560    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:49.767147 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:49.767119    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:49.883321 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:49.883289    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:49.884282 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:49.884262    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:38:50.861102 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:50.861048    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:50.957018 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:50.956981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:51.446977 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:51.446944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:51.547471 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:51.547431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:51.907431 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:51.907397    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:38:52.008058 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:38:52.008025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:05.641028 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:05.640983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:08.988167 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:08.988134    2572 generic.go:356] "Generic (PLEG): container finished" podID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerID="1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc" exitCode=0
Jul 28 21:39:08.988586 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:08.988209    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" event={"ID":"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988","Type":"ContainerDied","Data":"1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc"}
Jul 28 21:39:08.988639 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:08.988626    2572 scope.go:117] "RemoveContainer" containerID="1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc"
Jul 28 21:39:08.989712 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:08.989683    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:39:08.989793 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:08.989759    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:39:08.989837 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:08.989819    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 21:39:09.998987 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:09.998945    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" event={"ID":"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988","Type":"ContainerStarted","Data":"6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04"}
Jul 28 21:39:10.761419 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:10.761383    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:39:10.761647 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:10.761622    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 21:39:10.761742 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:10.761693    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 21:39:11.761349 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:11.761315    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 21:39:11.761734 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:11.761370    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 21:39:12.761563 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:12.761521    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 21:39:12.762001 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:12.761579    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 21:39:13.761647 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:13.761611    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 21:39:13.762092 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:13.761687    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 21:39:14.764603 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:14.764572    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:39:14.765055 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:14.764820    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:39:14.765623 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:14.765602    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:39:22.481082 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:22.481041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:22.581206 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:22.581169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:29.022515 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.022479    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:29.084910 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.084876    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:29.287190 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.287086    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"]
Jul 28 21:39:29.287435 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.287377    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy" containerID="cri-o://6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04" gracePeriod=30
Jul 28 21:39:29.310117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.310083    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:29.528253 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.528218    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:29.767992 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.767960    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:39:29.768166 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:29.768022    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:39:34.553652 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.553577    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:39:34.636503 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636468    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istiod-ca-cert\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.636721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636514    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-certs\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.636721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636548    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-socket\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.636721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636637    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-envoy\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.636721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636675    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-data\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.636721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636698    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-podinfo\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.637039 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636735    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-token\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.637039 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636834    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzdpk\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-kube-api-access-kzdpk\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.637039 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636832    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:39:34.637039 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636870    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-credential-socket\") pod \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\" (UID: \"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988\") "
Jul 28 21:39:34.637039 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.636929    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:39:34.637039 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.637011    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:39:34.637367 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.637320    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.637367 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.637341    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.637367 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.637353    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.637367 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.637320    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:39:34.638125 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.638097    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-data" (OuterVolumeSpecName: "istio-data") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:39:34.639149 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.639126    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-token" (OuterVolumeSpecName: "istio-token") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:39:34.639260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.639224    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:39:34.639260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.639237    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:39:34.639357 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.639257    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-kube-api-access-kzdpk" (OuterVolumeSpecName: "kube-api-access-kzdpk") pod "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" (UID: "df40dbf0-7ea6-45f7-a4e6-515bd0e7e988"). InnerVolumeSpecName "kube-api-access-kzdpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:39:34.738377 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.738335    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.738377 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.738372    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.738377 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.738385    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.738626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.738394    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.738626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.738402    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:34.738626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:34.738412    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzdpk\" (UniqueName: \"kubernetes.io/projected/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988-kube-api-access-kzdpk\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:35.138434 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.138397    2572 generic.go:356] "Generic (PLEG): container finished" podID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerID="6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04" exitCode=0
Jul 28 21:39:35.138644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.138448    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"
Jul 28 21:39:35.138644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.138463    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" event={"ID":"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988","Type":"ContainerDied","Data":"6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04"}
Jul 28 21:39:35.138644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.138516    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969" event={"ID":"df40dbf0-7ea6-45f7-a4e6-515bd0e7e988","Type":"ContainerDied","Data":"3b24b14795f6c8292f206997def926601d0e45e37cd2e2bb8505b2c334e1cd1c"}
Jul 28 21:39:35.138644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.138544    2572 scope.go:117] "RemoveContainer" containerID="6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04"
Jul 28 21:39:35.149061 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.149042    2572 scope.go:117] "RemoveContainer" containerID="1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc"
Jul 28 21:39:35.157911 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.157894    2572 scope.go:117] "RemoveContainer" containerID="6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04"
Jul 28 21:39:35.158130 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:39:35.158112    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04\": container with ID starting with 6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04 not found: ID does not exist" containerID="6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04"
Jul 28 21:39:35.158177 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.158138    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04"} err="failed to get container status \"6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04\": rpc error: code = NotFound desc = could not find container \"6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04\": container with ID starting with 6d5cf78b231b0fbcea6ac2bc0ac3bb8e9f6bd4d9e3cf3f7fb1e97226d3dd4d04 not found: ID does not exist"
Jul 28 21:39:35.158177 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.158156    2572 scope.go:117] "RemoveContainer" containerID="1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc"
Jul 28 21:39:35.158438 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:39:35.158417    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc\": container with ID starting with 1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc not found: ID does not exist" containerID="1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc"
Jul 28 21:39:35.158500 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.158444    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc"} err="failed to get container status \"1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc\": rpc error: code = NotFound desc = could not find container \"1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc\": container with ID starting with 1af3cdd1a1ccef2d14546c4bb868630f04c5ecc2baa4cf77b9abf0049fa17ffc not found: ID does not exist"
Jul 28 21:39:35.161974 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.161953    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"]
Jul 28 21:39:35.165871 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.165850    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969"]
Jul 28 21:39:35.719952 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:35.719913    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" path="/var/lib/kubelet/pods/df40dbf0-7ea6-45f7-a4e6-515bd0e7e988/volumes"
Jul 28 21:39:44.707184 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:44.707145    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:44.731926 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:44.731890    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"]
Jul 28 21:39:44.732161 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:44.732134    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6" podUID="90f62181-0dfa-4039-b9d2-0bb54f5b07d2" containerName="payload-processing" containerID="cri-o://fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c" gracePeriod=30
Jul 28 21:39:44.738293 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:44.738085    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"]
Jul 28 21:39:44.738502 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:44.738356    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm" podUID="91995ff7-585a-4eba-8b55-5926aa962da0" containerName="payload-pre-processing" containerID="cri-o://79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4" gracePeriod=30
Jul 28 21:39:44.803534 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:44.803497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:44.903897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:44.903803    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:45.037717 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.037691    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:39:45.040191 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.040166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:45.073881 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.073841    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:39:45.146606 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.146572    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-plugins-config-volume\") pod \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") "
Jul 28 21:39:45.146868 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.146645    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m4lt\" (UniqueName: \"kubernetes.io/projected/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-kube-api-access-4m4lt\") pod \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\" (UID: \"90f62181-0dfa-4039-b9d2-0bb54f5b07d2\") "
Jul 28 21:39:45.146972 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.146949    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90f62181-0dfa-4039-b9d2-0bb54f5b07d2" (UID: "90f62181-0dfa-4039-b9d2-0bb54f5b07d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:39:45.148918 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.148896    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-kube-api-access-4m4lt" (OuterVolumeSpecName: "kube-api-access-4m4lt") pod "90f62181-0dfa-4039-b9d2-0bb54f5b07d2" (UID: "90f62181-0dfa-4039-b9d2-0bb54f5b07d2"). InnerVolumeSpecName "kube-api-access-4m4lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:39:45.196051 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.196012    2572 generic.go:356] "Generic (PLEG): container finished" podID="91995ff7-585a-4eba-8b55-5926aa962da0" containerID="79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4" exitCode=0
Jul 28 21:39:45.196051 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.196055    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"
Jul 28 21:39:45.196310 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.196108    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm" event={"ID":"91995ff7-585a-4eba-8b55-5926aa962da0","Type":"ContainerDied","Data":"79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4"}
Jul 28 21:39:45.196310 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.196161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm" event={"ID":"91995ff7-585a-4eba-8b55-5926aa962da0","Type":"ContainerDied","Data":"f71f403b571a85dd455207680ea54d270c7f2dc3f0bfd54bec27094d5be60d50"}
Jul 28 21:39:45.196310 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.196183    2572 scope.go:117] "RemoveContainer" containerID="79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4"
Jul 28 21:39:45.197450 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.197430    2572 generic.go:356] "Generic (PLEG): container finished" podID="90f62181-0dfa-4039-b9d2-0bb54f5b07d2" containerID="fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c" exitCode=0
Jul 28 21:39:45.197546 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.197474    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"
Jul 28 21:39:45.197546 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.197475    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6" event={"ID":"90f62181-0dfa-4039-b9d2-0bb54f5b07d2","Type":"ContainerDied","Data":"fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c"}
Jul 28 21:39:45.197852 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.197560    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6" event={"ID":"90f62181-0dfa-4039-b9d2-0bb54f5b07d2","Type":"ContainerDied","Data":"5864a003033caf6073615a70fd43cca4b22e71ae350ec732e94fafc616353be2"}
Jul 28 21:39:45.205479 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.205444    2572 scope.go:117] "RemoveContainer" containerID="79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4"
Jul 28 21:39:45.205827 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:39:45.205803    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4\": container with ID starting with 79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4 not found: ID does not exist" containerID="79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4"
Jul 28 21:39:45.205906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.205838    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4"} err="failed to get container status \"79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4\": rpc error: code = NotFound desc = could not find container \"79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4\": container with ID starting with 79768998c994d686365c6ed640e4b8473449589697ec52a9349e7ad45af889b4 not found: ID does not exist"
Jul 28 21:39:45.205906 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.205857    2572 scope.go:117] "RemoveContainer" containerID="fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c"
Jul 28 21:39:45.214905 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.214885    2572 scope.go:117] "RemoveContainer" containerID="fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c"
Jul 28 21:39:45.215213 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:39:45.215193    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c\": container with ID starting with fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c not found: ID does not exist" containerID="fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c"
Jul 28 21:39:45.215288 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.215220    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c"} err="failed to get container status \"fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c\": rpc error: code = NotFound desc = could not find container \"fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c\": container with ID starting with fa9eb2635fa1268725213a5a57e48da7cb0ef04f8c5923c9835d130d5d1cd09c not found: ID does not exist"
Jul 28 21:39:45.221368 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.221344    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"]
Jul 28 21:39:45.225901 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.225875    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6"]
Jul 28 21:39:45.248025 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.247938    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91995ff7-585a-4eba-8b55-5926aa962da0-plugins-config-volume\") pod \"91995ff7-585a-4eba-8b55-5926aa962da0\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") "
Jul 28 21:39:45.248170 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.248087    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hwvl\" (UniqueName: \"kubernetes.io/projected/91995ff7-585a-4eba-8b55-5926aa962da0-kube-api-access-2hwvl\") pod \"91995ff7-585a-4eba-8b55-5926aa962da0\" (UID: \"91995ff7-585a-4eba-8b55-5926aa962da0\") "
Jul 28 21:39:45.248322 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.248300    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91995ff7-585a-4eba-8b55-5926aa962da0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91995ff7-585a-4eba-8b55-5926aa962da0" (UID: "91995ff7-585a-4eba-8b55-5926aa962da0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:39:45.248411 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.248396    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91995ff7-585a-4eba-8b55-5926aa962da0-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:45.248458 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.248414    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:45.248458 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.248423    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m4lt\" (UniqueName: \"kubernetes.io/projected/90f62181-0dfa-4039-b9d2-0bb54f5b07d2-kube-api-access-4m4lt\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:45.250272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.250251    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91995ff7-585a-4eba-8b55-5926aa962da0-kube-api-access-2hwvl" (OuterVolumeSpecName: "kube-api-access-2hwvl") pod "91995ff7-585a-4eba-8b55-5926aa962da0" (UID: "91995ff7-585a-4eba-8b55-5926aa962da0"). InnerVolumeSpecName "kube-api-access-2hwvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:39:45.349197 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.349145    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hwvl\" (UniqueName: \"kubernetes.io/projected/91995ff7-585a-4eba-8b55-5926aa962da0-kube-api-access-2hwvl\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:39:45.431026 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.430987    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:45.518230 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.518195    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"]
Jul 28 21:39:45.521959 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.521927    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm"]
Jul 28 21:39:45.525182 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:39:45.525158    2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91995ff7_585a_4eba_8b55_5926aa962da0.slice/crio-f71f403b571a85dd455207680ea54d270c7f2dc3f0bfd54bec27094d5be60d50\": RecentStats: unable to find data in memory cache]"
Jul 28 21:39:45.717749 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.717716    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90f62181-0dfa-4039-b9d2-0bb54f5b07d2" path="/var/lib/kubelet/pods/90f62181-0dfa-4039-b9d2-0bb54f5b07d2/volumes"
Jul 28 21:39:45.718152 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:45.718121    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91995ff7-585a-4eba-8b55-5926aa962da0" path="/var/lib/kubelet/pods/91995ff7-585a-4eba-8b55-5926aa962da0/volumes"
Jul 28 21:39:50.515087 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:50.515049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:39:55.920934 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:55.920905    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:39:55.924641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:55.924621    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:39:56.644764 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:39:56.644716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:02.550571 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:02.550505    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:03.310446 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:03.310412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:07.720395 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:07.720338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:26.802690 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:26.802564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:28.350880 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:28.350837    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:34.624721 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:34.624682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:50.288882 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:50.288829    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:50.389354 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:50.389321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:50.553402 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:50.553307    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"]
Jul 28 21:40:50.553648 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:50.553601    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy" containerID="cri-o://571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880" gracePeriod=30
Jul 28 21:40:50.570999 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:50.570972    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:50.811595 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:50.811440    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:55.713151 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.713112    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 28 21:40:55.713631 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.713181    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 28 21:40:55.821344 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.821270    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:40:55.926742 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.926705    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-envoy\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.926957 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.926767    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-socket\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.926957 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.926854    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8nrc\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-kube-api-access-j8nrc\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.926957 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.926879    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-token\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.926957 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.926931    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-data\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.927181 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927016    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:40:55.927181 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927038    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-certs\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.927181 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927104    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d5422e-a9a7-4ce2-a502-f911efa52a94-istiod-ca-cert\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.927181 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927155    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-credential-socket\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.927376 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927183    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-podinfo\") pod \"35d5422e-a9a7-4ce2-a502-f911efa52a94\" (UID: \"35d5422e-a9a7-4ce2-a502-f911efa52a94\") "
Jul 28 21:40:55.927475 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927447    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d5422e-a9a7-4ce2-a502-f911efa52a94-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:40:55.927530 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927480    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:40:55.927763 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927558    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:55.927763 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927708    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d5422e-a9a7-4ce2-a502-f911efa52a94-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:55.928089 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.927944    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-data" (OuterVolumeSpecName: "istio-data") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:40:55.928219 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.928180    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:40:55.929372 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.929347    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-token" (OuterVolumeSpecName: "istio-token") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:40:55.929509 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.929491    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:40:55.929679 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.929653    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:40:55.929796 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:55.929718    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-kube-api-access-j8nrc" (OuterVolumeSpecName: "kube-api-access-j8nrc") pod "35d5422e-a9a7-4ce2-a502-f911efa52a94" (UID: "35d5422e-a9a7-4ce2-a502-f911efa52a94"). InnerVolumeSpecName "kube-api-access-j8nrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:40:56.028669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.028630    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8nrc\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-kube-api-access-j8nrc\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:56.028669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.028663    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:56.028669 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.028672    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:56.028961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.028683    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:56.028961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.028692    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:56.028961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.028700    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:56.028961 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.028707    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d5422e-a9a7-4ce2-a502-f911efa52a94-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:56.589599 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.589561    2572 generic.go:356] "Generic (PLEG): container finished" podID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerID="571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880" exitCode=0
Jul 28 21:40:56.589835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.589605    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"
Jul 28 21:40:56.589835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.589633    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" event={"ID":"35d5422e-a9a7-4ce2-a502-f911efa52a94","Type":"ContainerDied","Data":"571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880"}
Jul 28 21:40:56.589835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.589691    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5" event={"ID":"35d5422e-a9a7-4ce2-a502-f911efa52a94","Type":"ContainerDied","Data":"28ce76d6ac525cd5eae3882bca3d54ca126a2eef3fdaaa3f2f76485f369ba850"}
Jul 28 21:40:56.589835 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.589736    2572 scope.go:117] "RemoveContainer" containerID="571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880"
Jul 28 21:40:56.601670 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.601651    2572 scope.go:117] "RemoveContainer" containerID="40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a"
Jul 28 21:40:56.610155 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.610129    2572 scope.go:117] "RemoveContainer" containerID="571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880"
Jul 28 21:40:56.610424 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:40:56.610397    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880\": container with ID starting with 571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880 not found: ID does not exist" containerID="571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880"
Jul 28 21:40:56.610521 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.610438    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880"} err="failed to get container status \"571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880\": rpc error: code = NotFound desc = could not find container \"571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880\": container with ID starting with 571898763c9ceed1af9deaf76d7b74057a6b92623358b4de7fa965832029b880 not found: ID does not exist"
Jul 28 21:40:56.610521 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.610465    2572 scope.go:117] "RemoveContainer" containerID="40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a"
Jul 28 21:40:56.610916 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:40:56.610814    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a\": container with ID starting with 40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a not found: ID does not exist" containerID="40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a"
Jul 28 21:40:56.610916 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.610844    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a"} err="failed to get container status \"40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a\": rpc error: code = NotFound desc = could not find container \"40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a\": container with ID starting with 40b688b0a5ba0ef1881bb14c9c1e98937a6413756aff24086121f9ee80c20b7a not found: ID does not exist"
Jul 28 21:40:56.613748 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.613727    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"]
Jul 28 21:40:56.621823 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.617484    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5"]
Jul 28 21:40:56.976488 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:56.976450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:57.027242 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.027206    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"]
Jul 28 21:40:57.027482 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.027458    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt" podUID="39fd2c50-0f57-4589-85c9-f88f7e820c84" containerName="payload-processing" containerID="cri-o://57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e" gracePeriod=30
Jul 28 21:40:57.136904 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.136857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:57.235927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.235840    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:57.309038 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.309008    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:40:57.331281 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.331244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:57.442836 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.442772    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fd2c50-0f57-4589-85c9-f88f7e820c84-plugins-config-volume\") pod \"39fd2c50-0f57-4589-85c9-f88f7e820c84\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") "
Jul 28 21:40:57.442997 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.442851    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h48ql\" (UniqueName: \"kubernetes.io/projected/39fd2c50-0f57-4589-85c9-f88f7e820c84-kube-api-access-h48ql\") pod \"39fd2c50-0f57-4589-85c9-f88f7e820c84\" (UID: \"39fd2c50-0f57-4589-85c9-f88f7e820c84\") "
Jul 28 21:40:57.443174 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.443147    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fd2c50-0f57-4589-85c9-f88f7e820c84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39fd2c50-0f57-4589-85c9-f88f7e820c84" (UID: "39fd2c50-0f57-4589-85c9-f88f7e820c84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:40:57.445187 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.445161    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39fd2c50-0f57-4589-85c9-f88f7e820c84-kube-api-access-h48ql" (OuterVolumeSpecName: "kube-api-access-h48ql") pod "39fd2c50-0f57-4589-85c9-f88f7e820c84" (UID: "39fd2c50-0f57-4589-85c9-f88f7e820c84"). InnerVolumeSpecName "kube-api-access-h48ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:40:57.544070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.543966    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fd2c50-0f57-4589-85c9-f88f7e820c84-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:57.544070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.544003    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h48ql\" (UniqueName: \"kubernetes.io/projected/39fd2c50-0f57-4589-85c9-f88f7e820c84-kube-api-access-h48ql\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:40:57.597386 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.597349    2572 generic.go:356] "Generic (PLEG): container finished" podID="39fd2c50-0f57-4589-85c9-f88f7e820c84" containerID="57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e" exitCode=0
Jul 28 21:40:57.597593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.597405    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"
Jul 28 21:40:57.597593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.597442    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt" event={"ID":"39fd2c50-0f57-4589-85c9-f88f7e820c84","Type":"ContainerDied","Data":"57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e"}
Jul 28 21:40:57.597593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.597504    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt" event={"ID":"39fd2c50-0f57-4589-85c9-f88f7e820c84","Type":"ContainerDied","Data":"5d74c6d163745ff6c39beead02843783aa9d3c50df1c0f8de1e7c6caf580de11"}
Jul 28 21:40:57.597593 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.597531    2572 scope.go:117] "RemoveContainer" containerID="57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e"
Jul 28 21:40:57.607944 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.607926    2572 scope.go:117] "RemoveContainer" containerID="57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e"
Jul 28 21:40:57.608291 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:40:57.608268    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e\": container with ID starting with 57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e not found: ID does not exist" containerID="57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e"
Jul 28 21:40:57.608371 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.608299    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e"} err="failed to get container status \"57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e\": rpc error: code = NotFound desc = could not find container \"57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e\": container with ID starting with 57299c40e170662f84cae6cdb6c87250e453e27263e7def35b118ffed0c6c78e not found: ID does not exist"
Jul 28 21:40:57.621942 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.621907    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"]
Jul 28 21:40:57.623842 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.623821    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt"]
Jul 28 21:40:57.625697 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.625676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:40:57.718362 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.718323    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" path="/var/lib/kubelet/pods/35d5422e-a9a7-4ce2-a502-f911efa52a94/volumes"
Jul 28 21:40:57.718829 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:40:57.718696    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39fd2c50-0f57-4589-85c9-f88f7e820c84" path="/var/lib/kubelet/pods/39fd2c50-0f57-4589-85c9-f88f7e820c84/volumes"
Jul 28 21:41:04.027448 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.027410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:04.127897 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.127863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:04.344731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.344640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:04.662005 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.661968    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:04.785244 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785209    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"]
Jul 28 21:41:04.785660 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785646    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy"
Jul 28 21:41:04.785723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785663    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy"
Jul 28 21:41:04.785723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785679    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f62181-0dfa-4039-b9d2-0bb54f5b07d2" containerName="payload-processing"
Jul 28 21:41:04.785723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785686    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f62181-0dfa-4039-b9d2-0bb54f5b07d2" containerName="payload-processing"
Jul 28 21:41:04.785723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785702    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91995ff7-585a-4eba-8b55-5926aa962da0" containerName="payload-pre-processing"
Jul 28 21:41:04.785723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785709    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="91995ff7-585a-4eba-8b55-5926aa962da0" containerName="payload-pre-processing"
Jul 28 21:41:04.785723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785718    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39fd2c50-0f57-4589-85c9-f88f7e820c84" containerName="payload-processing"
Jul 28 21:41:04.785723 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785723    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="39fd2c50-0f57-4589-85c9-f88f7e820c84" containerName="payload-processing"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785730    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785736    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785753    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785761    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785828    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="39fd2c50-0f57-4589-85c9-f88f7e820c84" containerName="payload-processing"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785840    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="91995ff7-585a-4eba-8b55-5926aa962da0" containerName="payload-pre-processing"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785848    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785856    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="90f62181-0dfa-4039-b9d2-0bb54f5b07d2" containerName="payload-processing"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785863    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785868    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy"
Jul 28 21:41:04.785976 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.785873    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="df40dbf0-7ea6-45f7-a4e6-515bd0e7e988" containerName="istio-proxy"
Jul 28 21:41:04.790318 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.790297    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"
Jul 28 21:41:04.793022 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.792999    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wt6gl\""
Jul 28 21:41:04.801524 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.801466    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"]
Jul 28 21:41:04.918975 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:04.918878    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2cec408-a5a8-4363-97a9-0d9fa66c9872-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld\" (UID: \"e2cec408-a5a8-4363-97a9-0d9fa66c9872\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"
Jul 28 21:41:05.019629 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:05.019597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2cec408-a5a8-4363-97a9-0d9fa66c9872-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld\" (UID: \"e2cec408-a5a8-4363-97a9-0d9fa66c9872\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"
Jul 28 21:41:05.020246 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:05.020219    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2cec408-a5a8-4363-97a9-0d9fa66c9872-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld\" (UID: \"e2cec408-a5a8-4363-97a9-0d9fa66c9872\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"
Jul 28 21:41:05.102907 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:05.102871    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"
Jul 28 21:41:05.247312 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:05.247279    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"]
Jul 28 21:41:05.249226 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:41:05.249178    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2cec408_a5a8_4363_97a9_0d9fa66c9872.slice/crio-6b10b87a2c4d53a97d722fd4d78d5c320b9db5745e0ed1ad070730309856122b WatchSource:0}: Error finding container 6b10b87a2c4d53a97d722fd4d78d5c320b9db5745e0ed1ad070730309856122b: Status 404 returned error can't find the container with id 6b10b87a2c4d53a97d722fd4d78d5c320b9db5745e0ed1ad070730309856122b
Jul 28 21:41:05.646269 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:05.646229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld" event={"ID":"e2cec408-a5a8-4363-97a9-0d9fa66c9872","Type":"ContainerStarted","Data":"d59b9cafbf6a67ce38874e3d58edbc842b375382557692084108e26e2c77e250"}
Jul 28 21:41:05.646449 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:05.646286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld" event={"ID":"e2cec408-a5a8-4363-97a9-0d9fa66c9872","Type":"ContainerStarted","Data":"6b10b87a2c4d53a97d722fd4d78d5c320b9db5745e0ed1ad070730309856122b"}
Jul 28 21:41:05.660843 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:05.660762    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld" podStartSLOduration=1.660741413 podStartE2EDuration="1.660741413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:41:05.66035528 +0000 UTC m=+3370.494598867" watchObservedRunningTime="2026-07-28 21:41:05.660741413 +0000 UTC m=+3370.494985000"
Jul 28 21:41:06.653006 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:06.652971    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2cec408-a5a8-4363-97a9-0d9fa66c9872" containerID="d59b9cafbf6a67ce38874e3d58edbc842b375382557692084108e26e2c77e250" exitCode=0
Jul 28 21:41:06.653442 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:06.653021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld" event={"ID":"e2cec408-a5a8-4363-97a9-0d9fa66c9872","Type":"ContainerDied","Data":"d59b9cafbf6a67ce38874e3d58edbc842b375382557692084108e26e2c77e250"}
Jul 28 21:41:07.807604 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:07.807578    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"
Jul 28 21:41:07.945408 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:07.945322    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2cec408-a5a8-4363-97a9-0d9fa66c9872-maas-api-service-ca\") pod \"e2cec408-a5a8-4363-97a9-0d9fa66c9872\" (UID: \"e2cec408-a5a8-4363-97a9-0d9fa66c9872\") "
Jul 28 21:41:07.945732 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:07.945711    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2cec408-a5a8-4363-97a9-0d9fa66c9872-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2cec408-a5a8-4363-97a9-0d9fa66c9872" (UID: "e2cec408-a5a8-4363-97a9-0d9fa66c9872"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:41:08.046511 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:08.046474    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2cec408-a5a8-4363-97a9-0d9fa66c9872-maas-api-service-ca\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:08.672346 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:08.672311    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"
Jul 28 21:41:08.672555 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:08.672347    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld" event={"ID":"e2cec408-a5a8-4363-97a9-0d9fa66c9872","Type":"ContainerDied","Data":"6b10b87a2c4d53a97d722fd4d78d5c320b9db5745e0ed1ad070730309856122b"}
Jul 28 21:41:08.672555 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:08.672421    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b10b87a2c4d53a97d722fd4d78d5c320b9db5745e0ed1ad070730309856122b"
Jul 28 21:41:12.439824 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.439762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:12.444147 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.444117    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"]
Jul 28 21:41:12.447556 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.447524    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b439d9-29754570-q4ddj"]
Jul 28 21:41:12.476970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.476929    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"]
Jul 28 21:41:12.477245 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.477196    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84" podUID="55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" containerName="payload-processing" containerID="cri-o://40d68a3dbde3e237ccfcc4aeaef28d72d8c31b1ef60a4d78baaeceba2fc032a3" gracePeriod=30
Jul 28 21:41:12.484001 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.483924    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"]
Jul 28 21:41:12.484356 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.484309    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5" podUID="9fb0a3af-e66c-4419-abe5-a3e171a9ec09" containerName="payload-pre-processing" containerID="cri-o://8a9586af363d68860e523372ea9808d8f1f45e7189aa94f1f0f67430e69b544c" gracePeriod=30
Jul 28 21:41:12.518272 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.518235    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:12.579731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.579697    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:12.631970 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.631905    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"]
Jul 28 21:41:12.635008 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.634976    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b439d9-xhsld"]
Jul 28 21:41:12.648507 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.648470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:12.697281 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.697129    2572 generic.go:356] "Generic (PLEG): container finished" podID="9fb0a3af-e66c-4419-abe5-a3e171a9ec09" containerID="8a9586af363d68860e523372ea9808d8f1f45e7189aa94f1f0f67430e69b544c" exitCode=0
Jul 28 21:41:12.697281 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.697241    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5" event={"ID":"9fb0a3af-e66c-4419-abe5-a3e171a9ec09","Type":"ContainerDied","Data":"8a9586af363d68860e523372ea9808d8f1f45e7189aa94f1f0f67430e69b544c"}
Jul 28 21:41:12.699082 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.698995    2572 generic.go:356] "Generic (PLEG): container finished" podID="55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" containerID="40d68a3dbde3e237ccfcc4aeaef28d72d8c31b1ef60a4d78baaeceba2fc032a3" exitCode=0
Jul 28 21:41:12.699379 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.699321    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84" event={"ID":"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe","Type":"ContainerDied","Data":"40d68a3dbde3e237ccfcc4aeaef28d72d8c31b1ef60a4d78baaeceba2fc032a3"}
Jul 28 21:41:12.758840 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.758812    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:41:12.791374 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.791348    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-plugins-config-volume\") pod \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") "
Jul 28 21:41:12.791550 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.791389    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98lhf\" (UniqueName: \"kubernetes.io/projected/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-kube-api-access-98lhf\") pod \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\" (UID: \"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe\") "
Jul 28 21:41:12.791793 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.791751    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" (UID: "55d153df-aca1-4862-8c4d-2f9e9a8ce1fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:41:12.793947 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.793921    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-kube-api-access-98lhf" (OuterVolumeSpecName: "kube-api-access-98lhf") pod "55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" (UID: "55d153df-aca1-4862-8c4d-2f9e9a8ce1fe"). InnerVolumeSpecName "kube-api-access-98lhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:41:12.797166 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.797144    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:41:12.892598 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.892562    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-plugins-config-volume\") pod \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") "
Jul 28 21:41:12.892914 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.892661    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmmwz\" (UniqueName: \"kubernetes.io/projected/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-kube-api-access-zmmwz\") pod \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\" (UID: \"9fb0a3af-e66c-4419-abe5-a3e171a9ec09\") "
Jul 28 21:41:12.892914 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.892817    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:12.892914 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.892827    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98lhf\" (UniqueName: \"kubernetes.io/projected/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe-kube-api-access-98lhf\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:12.893100 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.893066    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9fb0a3af-e66c-4419-abe5-a3e171a9ec09" (UID: "9fb0a3af-e66c-4419-abe5-a3e171a9ec09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:41:12.895052 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.895023    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-kube-api-access-zmmwz" (OuterVolumeSpecName: "kube-api-access-zmmwz") pod "9fb0a3af-e66c-4419-abe5-a3e171a9ec09" (UID: "9fb0a3af-e66c-4419-abe5-a3e171a9ec09"). InnerVolumeSpecName "kube-api-access-zmmwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:41:12.994315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.994220    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmmwz\" (UniqueName: \"kubernetes.io/projected/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-kube-api-access-zmmwz\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:12.994315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:12.994254    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fb0a3af-e66c-4419-abe5-a3e171a9ec09-plugins-config-volume\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:13.019744 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.019710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:13.706392 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.706360    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"
Jul 28 21:41:13.706923 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.706391    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84" event={"ID":"55d153df-aca1-4862-8c4d-2f9e9a8ce1fe","Type":"ContainerDied","Data":"45c2e80f45c17d7f8578e792ce29d5cd6919726cd5273dd6f4b88ae55859b6e9"}
Jul 28 21:41:13.706923 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.706460    2572 scope.go:117] "RemoveContainer" containerID="40d68a3dbde3e237ccfcc4aeaef28d72d8c31b1ef60a4d78baaeceba2fc032a3"
Jul 28 21:41:13.707973 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.707906    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5" event={"ID":"9fb0a3af-e66c-4419-abe5-a3e171a9ec09","Type":"ContainerDied","Data":"388b633ec9a8985474e8eabd6eca24c195f2a7ba4f0358e8bfeb67a930c64721"}
Jul 28 21:41:13.707973 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.707923    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"
Jul 28 21:41:13.716472 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.716453    2572 scope.go:117] "RemoveContainer" containerID="8a9586af363d68860e523372ea9808d8f1f45e7189aa94f1f0f67430e69b544c"
Jul 28 21:41:13.723495 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.723462    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2cec408-a5a8-4363-97a9-0d9fa66c9872" path="/var/lib/kubelet/pods/e2cec408-a5a8-4363-97a9-0d9fa66c9872/volumes"
Jul 28 21:41:13.724088 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.724062    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c31530-b0cd-4801-8d1f-6670380d16b3" path="/var/lib/kubelet/pods/f2c31530-b0cd-4801-8d1f-6670380d16b3/volumes"
Jul 28 21:41:13.733469 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.733435    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"]
Jul 28 21:41:13.736026 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.736000    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84"]
Jul 28 21:41:13.744494 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.744464    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"]
Jul 28 21:41:13.748285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:13.748197    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5"]
Jul 28 21:41:15.719288 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:15.719254    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" path="/var/lib/kubelet/pods/55d153df-aca1-4862-8c4d-2f9e9a8ce1fe/volumes"
Jul 28 21:41:15.719714 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:15.719606    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb0a3af-e66c-4419-abe5-a3e171a9ec09" path="/var/lib/kubelet/pods/9fb0a3af-e66c-4419-abe5-a3e171a9ec09/volumes"
Jul 28 21:41:20.002563 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:20.002518    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:20.104369 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:20.104337    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:20.270513 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:20.270417    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"]
Jul 28 21:41:20.270729 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:20.270682    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy" containerID="cri-o://65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222" gracePeriod=30
Jul 28 21:41:20.299521 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:20.299482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:20.536926 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:20.536826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:21.315266 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:21.315224    2572 patch_prober.go:28] interesting pod/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:41:21.315731 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:21.315304    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:41:25.184219 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.184181    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"]
Jul 28 21:41:25.189606 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.189573    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7076b1-29754570-w72qp"]
Jul 28 21:41:25.190922 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.190897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:25.289626 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.289587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:25.389170 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.389135    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:25.496009 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.495975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:25.546313 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.546289    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:41:25.617309 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617271    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fntvg\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-kube-api-access-fntvg\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617484 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617319    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-certs\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617484 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617345    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-socket\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617586 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617519    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-envoy\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617587    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-data\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617596    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:25.617644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617618    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-podinfo\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617644 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617639    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:25.617877 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617667    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istiod-ca-cert\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617877 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617697    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-credential-socket\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.617877 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.617734    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-token\") pod \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\" (UID: \"06e3b49f-dccd-4cd9-b634-5dedd0bcf855\") "
Jul 28 21:41:25.618066 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.618026    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:41:25.618406 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.618280    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:25.618506 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.618420    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.618506 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.618442    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.618506 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.618456    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.618506 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.618470    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.618738 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.618546    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-data" (OuterVolumeSpecName: "istio-data") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:25.619830 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.619798    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-kube-api-access-fntvg" (OuterVolumeSpecName: "kube-api-access-fntvg") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "kube-api-access-fntvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:41:25.619927 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.619847    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:25.620391 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.620366    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:41:25.620391 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.620376    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-token" (OuterVolumeSpecName: "istio-token") pod "06e3b49f-dccd-4cd9-b634-5dedd0bcf855" (UID: "06e3b49f-dccd-4cd9-b634-5dedd0bcf855"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:41:25.718170 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.718085    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f76d6552-efe2-48e4-a600-fe667db57ab9" path="/var/lib/kubelet/pods/f76d6552-efe2-48e4-a600-fe667db57ab9/volumes"
Jul 28 21:41:25.722285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.719683    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.722285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.719720    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fntvg\" (UniqueName: \"kubernetes.io/projected/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-kube-api-access-fntvg\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.722285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.719746    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.722285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.719761    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.722285 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.719801    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e3b49f-dccd-4cd9-b634-5dedd0bcf855-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:25.774461 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.774419    2572 generic.go:356] "Generic (PLEG): container finished" podID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerID="65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222" exitCode=0
Jul 28 21:41:25.774641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.774487    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" event={"ID":"06e3b49f-dccd-4cd9-b634-5dedd0bcf855","Type":"ContainerDied","Data":"65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222"}
Jul 28 21:41:25.774641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.774495    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"
Jul 28 21:41:25.774641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.774544    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf" event={"ID":"06e3b49f-dccd-4cd9-b634-5dedd0bcf855","Type":"ContainerDied","Data":"08c0e4d815237de5fa5031f7afcf0726bfb3a6aca34890d875fe9c3150268e0b"}
Jul 28 21:41:25.774641 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.774573    2572 scope.go:117] "RemoveContainer" containerID="65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222"
Jul 28 21:41:25.784479 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.784456    2572 scope.go:117] "RemoveContainer" containerID="4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70"
Jul 28 21:41:25.792632 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.792590    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"]
Jul 28 21:41:25.795226 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.795199    2572 scope.go:117] "RemoveContainer" containerID="65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222"
Jul 28 21:41:25.795722 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:41:25.795690    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222\": container with ID starting with 65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222 not found: ID does not exist" containerID="65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222"
Jul 28 21:41:25.795857 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.795733    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222"} err="failed to get container status \"65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222\": rpc error: code = NotFound desc = could not find container \"65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222\": container with ID starting with 65eaf46e5a2225c55e2055eebf13e3a93b7dc15757c363f2fccd27bdf9371222 not found: ID does not exist"
Jul 28 21:41:25.795857 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.795760    2572 scope.go:117] "RemoveContainer" containerID="4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70"
Jul 28 21:41:25.796144 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:41:25.796118    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70\": container with ID starting with 4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70 not found: ID does not exist" containerID="4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70"
Jul 28 21:41:25.796234 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.796149    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70"} err="failed to get container status \"4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70\": rpc error: code = NotFound desc = could not find container \"4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70\": container with ID starting with 4e8c664b8333f9ecd11e18f422cadfb296237820c70e910c2e99d81c01c0fe70 not found: ID does not exist"
Jul 28 21:41:25.797508 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.797487    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf"]
Jul 28 21:41:25.937737 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:25.937704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:27.119198 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:27.119155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:27.174117 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:27.174084    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:27.718070 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:27.718026    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" path="/var/lib/kubelet/pods/06e3b49f-dccd-4cd9-b634-5dedd0bcf855/volumes"
Jul 28 21:41:32.135612 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:32.135573    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:32.236049 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:32.236021    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:32.392649 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:32.392552    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"]
Jul 28 21:41:32.392854 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:32.392810    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy" containerID="cri-o://c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61" gracePeriod=30
Jul 28 21:41:32.414215 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:32.414161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:32.649302 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:32.649219    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:37.661073 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.660990    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:41:37.730065 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730027    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-token\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730065 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730070    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-envoy\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istiod-ca-cert\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730120    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-data\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730173    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-socket\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730198    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-credential-socket\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730237    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-podinfo\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730256    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb5r5\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-kube-api-access-gb5r5\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.730315 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.730285    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-certs\") pod \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\" (UID: \"7193ef37-66ee-4c7a-99ad-f0cb7842d47d\") "
Jul 28 21:41:37.731251 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.731108    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:37.731251 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.731124    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:37.731423 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.731302    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:41:37.732054 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.731869    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:37.732193 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.732051    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-data" (OuterVolumeSpecName: "istio-data") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:37.733336 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.733297    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:41:37.733762 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.733734    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:41:37.739740 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.734348    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:41:37.740247 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.740219    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-kube-api-access-gb5r5" (OuterVolumeSpecName: "kube-api-access-gb5r5") pod "7193ef37-66ee-4c7a-99ad-f0cb7842d47d" (UID: "7193ef37-66ee-4c7a-99ad-f0cb7842d47d"). InnerVolumeSpecName "kube-api-access-gb5r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:41:37.832303 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832257    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-podinfo\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832303 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832304    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb5r5\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-kube-api-access-gb5r5\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832322    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-certs\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832339    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-token\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832351    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-envoy\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832362    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istiod-ca-cert\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832373    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-istio-data\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832386    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-workload-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.832544 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.832397    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7193ef37-66ee-4c7a-99ad-f0cb7842d47d-credential-socket\") on node \"ip-10-0-133-57.ec2.internal\" DevicePath \"\""
Jul 28 21:41:37.841404 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.841366    2572 generic.go:356] "Generic (PLEG): container finished" podID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerID="c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61" exitCode=0
Jul 28 21:41:37.841582 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.841424    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" event={"ID":"7193ef37-66ee-4c7a-99ad-f0cb7842d47d","Type":"ContainerDied","Data":"c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61"}
Jul 28 21:41:37.841582 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.841443    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"
Jul 28 21:41:37.841582 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.841509    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7" event={"ID":"7193ef37-66ee-4c7a-99ad-f0cb7842d47d","Type":"ContainerDied","Data":"41943ad24d4b51c8690e9df3e197dc491a1f84ddc80aa65fb67b55c269186056"}
Jul 28 21:41:37.841582 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.841541    2572 scope.go:117] "RemoveContainer" containerID="c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61"
Jul 28 21:41:37.851858 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.851838    2572 scope.go:117] "RemoveContainer" containerID="190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a"
Jul 28 21:41:37.860902 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.860875    2572 scope.go:117] "RemoveContainer" containerID="c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61"
Jul 28 21:41:37.861459 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:41:37.861432    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61\": container with ID starting with c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61 not found: ID does not exist" containerID="c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61"
Jul 28 21:41:37.861545 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.861473    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61"} err="failed to get container status \"c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61\": rpc error: code = NotFound desc = could not find container \"c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61\": container with ID starting with c4aa129e841682e9172d95bbfcafdd59e3bba8c86d81aa464a8ddd07dc0acf61 not found: ID does not exist"
Jul 28 21:41:37.861545 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.861500    2572 scope.go:117] "RemoveContainer" containerID="190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a"
Jul 28 21:41:37.861869 ip-10-0-133-57 kubenswrapper[2572]: E0728 21:41:37.861842    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a\": container with ID starting with 190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a not found: ID does not exist" containerID="190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a"
Jul 28 21:41:37.861923 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.861881    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a"} err="failed to get container status \"190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a\": rpc error: code = NotFound desc = could not find container \"190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a\": container with ID starting with 190f06ed02525e6f722d1e73ae8b3d793453b7e188d70aa9a08cfca40ccdee2a not found: ID does not exist"
Jul 28 21:41:37.863196 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.863177    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"]
Jul 28 21:41:37.867200 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:37.867173    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7"]
Jul 28 21:41:38.566444 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:38.566417    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vpscr_7de08994-053f-4fd2-96a9-5797de72164f/manager/0.log"
Jul 28 21:41:38.683519 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:38.683491    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fmhqt_467881e0-4ad5-45bf-aa3c-c56fa226203a/manager/0.log"
Jul 28 21:41:38.926604 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:38.926578    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t94xs_b66c1e67-12e3-4fdd-84d3-34e11df20660/server/0.log"
Jul 28 21:41:39.050278 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:39.050249    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p79xv_8f74c053-9832-4008-b761-66483fc14854/manager/0.log"
Jul 28 21:41:39.291122 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:39.291048    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5966989555-l26n6_2502f14a-6d0c-466c-ab6d-f29b2c04a7a7/copy-manifests/0.log"
Jul 28 21:41:39.297695 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:39.297669    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5966989555-l26n6_2502f14a-6d0c-466c-ab6d-f29b2c04a7a7/manager/0.log"
Jul 28 21:41:39.717341 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:39.717309    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" path="/var/lib/kubelet/pods/7193ef37-66ee-4c7a-99ad-f0cb7842d47d/volumes"
Jul 28 21:41:39.806823 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:39.806792    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67cd878d8b-6znx8_efc3cc72-8cd5-4a88-b91c-83a7e6534596/maas-api/0.log"
Jul 28 21:41:39.929260 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:39.929232    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754540-wzq9v_b1bf2f80-9505-4a0d-ba9b-71443f528f10/cleanup/0.log"
Jul 28 21:41:42.503879 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:42.503854    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5vdkc_6a9107f1-9919-4911-ac2b-0583d2ce6f72/manager/0.log"
Jul 28 21:41:42.986362 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:42.986327    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pz96k_61827ce2-6385-47e6-b490-3974c6f99316/discovery/0.log"
Jul 28 21:41:43.217388 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:43.217351    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d6c74c55-smc56_8cb16501-26c7-4bc7-aab9-136a7c351c25/kube-auth-proxy/0.log"
Jul 28 21:41:43.462362 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:43.462328    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wsscd_c807f182-81ff-4345-a152-f7c5c94e702a/payload-pre-processing/0.log"
Jul 28 21:41:43.704254 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:43.704223    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff76cddc9-wcv8g_fe6d8528-3f55-46bd-b0ff-ad963b8a46f1/router/0.log"
Jul 28 21:41:44.069295 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:44.069269    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-l7gx8_212540bb-e908-4c73-b8a5-269ec243866d/main/0.log"
Jul 28 21:41:47.060484 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:47.060396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:50.267032 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:50.266994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:50.345126 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:50.345091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log" limit=1024
Jul 28 21:41:53.230221 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:53.230190    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5chvb_24d41e59-b89c-4178-91b2-af1dc84e86ed/global-pull-secret-syncer/0.log"
Jul 28 21:41:53.359760 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:53.359724    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-584kl_1d52b0f5-195f-4d56-9d01-74af61d80cee/konnectivity-agent/0.log"
Jul 28 21:41:53.454899 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:53.454869    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-57.ec2.internal_507b913257a62c292c095cec0ddb2c1c/haproxy/0.log"
Jul 28 21:41:56.250350 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:56.250320    2572 scope.go:117] "RemoveContainer" containerID="3a7e3006106ad338392703f1bbdb85e37c7c5cd8c3e8717899189dd9054c72d6"
Jul 28 21:41:56.258888 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:56.258865    2572 scope.go:117] "RemoveContainer" containerID="2d70ab549ce454c0be79b5f140a0cd0d2c1a37b550b859b4d6ebdb566c01bafb"
Jul 28 21:41:59.458229 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:41:59.458193    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5vdkc_6a9107f1-9919-4911-ac2b-0583d2ce6f72/manager/0.log"
Jul 28 21:42:01.231690 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:01.231662    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-z5nwx_066c3763-70d4-4496-9993-09cd26a2e18c/cluster-monitoring-operator/0.log"
Jul 28 21:42:01.583581 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:01.583504    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwr56_56625417-4fa8-4fa3-8ab0-b3fcc9012cdf/node-exporter/0.log"
Jul 28 21:42:01.606812 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:01.606766    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwr56_56625417-4fa8-4fa3-8ab0-b3fcc9012cdf/kube-rbac-proxy/0.log"
Jul 28 21:42:01.627409 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:01.627390    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwr56_56625417-4fa8-4fa3-8ab0-b3fcc9012cdf/init-textfile/0.log"
Jul 28 21:42:03.426393 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426355    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"]
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426753    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" containerName="payload-processing"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426763    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" containerName="payload-processing"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426772    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cec408-a5a8-4363-97a9-0d9fa66c9872" containerName="revoke-keys"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426791    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cec408-a5a8-4363-97a9-0d9fa66c9872" containerName="revoke-keys"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426809    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426817    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d5422e-a9a7-4ce2-a502-f911efa52a94" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426831    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb0a3af-e66c-4419-abe5-a3e171a9ec09" containerName="payload-pre-processing"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426838    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb0a3af-e66c-4419-abe5-a3e171a9ec09" containerName="payload-pre-processing"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426847    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426852    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426867    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426872    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426882    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426887    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy"
Jul 28 21:42:03.426884 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426892    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy"
Jul 28 21:42:03.427343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426898    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy"
Jul 28 21:42:03.427343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426960    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d153df-aca1-4862-8c4d-2f9e9a8ce1fe" containerName="payload-processing"
Jul 28 21:42:03.427343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426968    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e3b49f-dccd-4cd9-b634-5dedd0bcf855" containerName="istio-proxy"
Jul 28 21:42:03.427343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426974    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy"
Jul 28 21:42:03.427343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426981    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2cec408-a5a8-4363-97a9-0d9fa66c9872" containerName="revoke-keys"
Jul 28 21:42:03.427343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426988    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7193ef37-66ee-4c7a-99ad-f0cb7842d47d" containerName="istio-proxy"
Jul 28 21:42:03.427343 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.426993    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb0a3af-e66c-4419-abe5-a3e171a9ec09" containerName="payload-pre-processing"
Jul 28 21:42:03.431406 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.431388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.433801 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.433765    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-phbxh\"/\"kube-root-ca.crt\""
Jul 28 21:42:03.434944 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.434916    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-phbxh\"/\"default-dockercfg-xr4cn\""
Jul 28 21:42:03.434944 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.434936    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-phbxh\"/\"openshift-service-ca.crt\""
Jul 28 21:42:03.438637 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.438244    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"]
Jul 28 21:42:03.448833 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.448669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-sys\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.448833 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.448718    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-lib-modules\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.448833 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.448805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-podres\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.449127 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.448868    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-proc\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.449127 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.448922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7sp6\" (UniqueName: \"kubernetes.io/projected/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-kube-api-access-z7sp6\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.467473 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.467447    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-4mvzm_f45b548f-b66e-472f-ab6a-8b9a27b4a6e6/networking-console-plugin/0.log"
Jul 28 21:42:03.550460 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550425    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-sys\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550460 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550464    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-lib-modules\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550683 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550556    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-sys\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550683 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-podres\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550683 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550633    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-proc\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550683 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550650    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-podres\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550683 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550602    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-lib-modules\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550883 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7sp6\" (UniqueName: \"kubernetes.io/projected/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-kube-api-access-z7sp6\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.550883 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.550729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-proc\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.559224 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.559195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7sp6\" (UniqueName: \"kubernetes.io/projected/44f3bd91-12d8-49ae-9094-bc9dd3fe56d7-kube-api-access-z7sp6\") pod \"perf-node-gather-daemonset-prscl\" (UID: \"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7\") " pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.742473 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.742384    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:03.878900 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.878872    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"]
Jul 28 21:42:03.881017 ip-10-0-133-57 kubenswrapper[2572]: W0728 21:42:03.880990    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod44f3bd91_12d8_49ae_9094_bc9dd3fe56d7.slice/crio-36ec0c24215a390f5c352d65bc2d4579a21dc463837851fa236ebdf07d176d4f WatchSource:0}: Error finding container 36ec0c24215a390f5c352d65bc2d4579a21dc463837851fa236ebdf07d176d4f: Status 404 returned error can't find the container with id 36ec0c24215a390f5c352d65bc2d4579a21dc463837851fa236ebdf07d176d4f
Jul 28 21:42:03.973203 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:03.973171    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl" event={"ID":"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7","Type":"ContainerStarted","Data":"36ec0c24215a390f5c352d65bc2d4579a21dc463837851fa236ebdf07d176d4f"}
Jul 28 21:42:04.138531 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:04.138494    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/1.log"
Jul 28 21:42:04.143197 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:04.143175    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tbmzs_d77639c8-4cde-4fbb-bfd9-6135d793d25d/console-operator/2.log"
Jul 28 21:42:04.979531 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:04.979491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl" event={"ID":"44f3bd91-12d8-49ae-9094-bc9dd3fe56d7","Type":"ContainerStarted","Data":"9c6bbee1a58b7c8a1c427926f87e2fe5476f22b9e31b8b5bb6bdffafcee98bdf"}
Jul 28 21:42:04.979982 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:04.979601    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:04.997659 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:04.997607    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl" podStartSLOduration=1.9975911 podStartE2EDuration="1.9975911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 21:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:42:04.995770694 +0000 UTC m=+3429.830014276" watchObservedRunningTime="2026-07-28 21:42:04.9975911 +0000 UTC m=+3429.831834685"
Jul 28 21:42:05.268392 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:05.268317    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-jtcrb_52b65981-f714-4678-bd2e-c80ac42f2244/volume-data-source-validator/0.log"
Jul 28 21:42:06.431287 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:06.431253    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4jxs_23c0027b-a4e7-4939-8aaf-deda3a9ee484/dns/0.log"
Jul 28 21:42:06.451738 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:06.451716    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4jxs_23c0027b-a4e7-4939-8aaf-deda3a9ee484/kube-rbac-proxy/0.log"
Jul 28 21:42:06.475299 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:06.475273    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nw5c_d749b6ec-d33e-4b20-8d22-5f332ac2d721/dns-node-resolver/0.log"
Jul 28 21:42:07.150719 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:07.150690    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fzprj_9e85be9f-9b1d-4dee-95a0-9bca4a4b71ab/node-ca/0.log"
Jul 28 21:42:08.272719 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:08.272686    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pz96k_61827ce2-6385-47e6-b490-3974c6f99316/discovery/0.log"
Jul 28 21:42:08.318538 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:08.318509    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d6c74c55-smc56_8cb16501-26c7-4bc7-aab9-136a7c351c25/kube-auth-proxy/0.log"
Jul 28 21:42:08.404954 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:08.404926    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wsscd_c807f182-81ff-4345-a152-f7c5c94e702a/payload-pre-processing/0.log"
Jul 28 21:42:08.455589 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:08.455562    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff76cddc9-wcv8g_fe6d8528-3f55-46bd-b0ff-ad963b8a46f1/router/0.log"
Jul 28 21:42:09.284915 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:09.284878    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4gvn_e7b3e7e7-2c39-483b-93a7-fad9fef864e1/serve-healthcheck-canary/0.log"
Jul 28 21:42:09.772926 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:09.772899    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-dmh6c_f872cb95-d3c5-4f9c-a22f-73dc88da028d/insights-operator/0.log"
Jul 28 21:42:09.773238 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:09.773227    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-dmh6c_f872cb95-d3c5-4f9c-a22f-73dc88da028d/insights-operator/1.log"
Jul 28 21:42:09.795649 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:09.795623    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2j6wh_47466a8c-0bbb-483e-bcf4-7bed1250f202/kube-rbac-proxy/0.log"
Jul 28 21:42:09.822519 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:09.822482    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2j6wh_47466a8c-0bbb-483e-bcf4-7bed1250f202/exporter/0.log"
Jul 28 21:42:09.854586 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:09.854546    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2j6wh_47466a8c-0bbb-483e-bcf4-7bed1250f202/extractor/0.log"
Jul 28 21:42:10.994175 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:10.994149    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-phbxh/perf-node-gather-daemonset-prscl"
Jul 28 21:42:12.503635 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:12.503605    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vpscr_7de08994-053f-4fd2-96a9-5797de72164f/manager/0.log"
Jul 28 21:42:12.720637 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:12.720604    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fmhqt_467881e0-4ad5-45bf-aa3c-c56fa226203a/manager/0.log"
Jul 28 21:42:12.905704 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:12.905680    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t94xs_b66c1e67-12e3-4fdd-84d3-34e11df20660/server/0.log"
Jul 28 21:42:12.995015 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:12.994984    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p79xv_8f74c053-9832-4008-b761-66483fc14854/manager/0.log"
Jul 28 21:42:13.075432 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:13.075398    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5966989555-l26n6_2502f14a-6d0c-466c-ab6d-f29b2c04a7a7/manager/0.log"
Jul 28 21:42:13.097031 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:13.097005    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5966989555-l26n6_2502f14a-6d0c-466c-ab6d-f29b2c04a7a7/copy-manifests/0.log"
Jul 28 21:42:14.185943 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:14.185901    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pz96k_61827ce2-6385-47e6-b490-3974c6f99316/discovery/0.log"
Jul 28 21:42:14.216063 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:14.216034    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d6c74c55-smc56_8cb16501-26c7-4bc7-aab9-136a7c351c25/kube-auth-proxy/0.log"
Jul 28 21:42:14.289597 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:14.289564    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wsscd_c807f182-81ff-4345-a152-f7c5c94e702a/payload-pre-processing/0.log"
Jul 28 21:42:14.332078 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:14.332041    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff76cddc9-wcv8g_fe6d8528-3f55-46bd-b0ff-ad963b8a46f1/router/0.log"
Jul 28 21:42:15.839186 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:15.839154    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pz96k_61827ce2-6385-47e6-b490-3974c6f99316/discovery/0.log"
Jul 28 21:42:15.870092 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:15.870068    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77d6c74c55-smc56_8cb16501-26c7-4bc7-aab9-136a7c351c25/kube-auth-proxy/0.log"
Jul 28 21:42:15.941330 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:15.941298    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-wsscd_c807f182-81ff-4345-a152-f7c5c94e702a/payload-pre-processing/0.log"
Jul 28 21:42:15.977217 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:15.977180    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff76cddc9-wcv8g_fe6d8528-3f55-46bd-b0ff-ad963b8a46f1/router/0.log"
Jul 28 21:42:19.900470 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:19.900435    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-t592p_9bcb3f8a-3b1b-434b-bb58-791882b8b654/kube-storage-version-migrator-operator/1.log"
Jul 28 21:42:19.901253 ip-10-0-133-57 kubenswrapper[2572]: I0728 21:42:19.901237    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-t592p_9bcb3f8a-3b1b-434b-bb58-791882b8b654/kube-storage-version-migrator-operator/0.log"